Please scroll down, To apply

Data Engineer 3

hiring now
New job

Russell Tobin & Associates

2024-05-08 17:04:20

Job location Austin, Texas, United States

Job type: fulltime

Job industry: I.T. & Communications

Job description



What are we looking for in our Data Engineer 3?

Position: Data Engineer
Location: Remote
Contract: 6 Months (Extension Likely) W2
Pay: $50-$57/HR (DOE)

Duties:

  • Data Asset Inventory and Assessment
  • Inventory of existing data assets; tables, dashboards, and pipelines
  • Follow requirements to pull required data to measure the current state of these assets, set up usage metrics for internal and external stakeholders.
  • Table Metadata to improve documentation coverage for tables, including table descriptions, column definitions, and data lineage.
  • Implement a centralized metadata management system to maintain and access asset documentation.
  • Ensure that all existing and new data assets are properly documented according to established standards.
  • Pipeline Clean-up and Consolidation
  • Consolidate and streamline pipelines by eliminating redundancies and unnecessary elements according to the set of provided rules.
  • Clean up and restructure data tables, ensuring consistent naming conventions, data types, and schema definitions.
  • Retire or archive obsolete dashboards and workflows.
  • Implement monitoring and alerting mechanisms for critical workflows to ensure timely issue detection and resolution.
  • Set up a foundation for scalable Data Model for the Stock Business - Implement and build performant data models to solve common analytics use-
  • Knowledge Transfer and Documentation
  • Thoroughly document the work performed, including methodologies, decisions, and any scripts or tools developed.
  • Provide comprehensive knowledge transfer to the data team, ensuring a smooth transition and the ability to maintain the optimized data environment.

Skills:
  • Proven experience in data engineering and data asset management.
  • Proficiency in SQL, Python, and other relevant data processing languages and tools.
  • Expertise in data modeling, ETL processes, and workflow orchestration (e.g., Airflow, Databricks).
  • Strong analytical and problem-solving skills.
  • Excellent communication and documentation abilities.
  • Familiarity with cloud data platforms (e.g., Azure, AWS, GCP) is a plus.

Pride Global offers eligible employee's comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), 401(k)-retirement savings, life & disability insurance, an employee assistance program, legal support, auto, home insurance, pet insurance and employee discounts with preferred vendors.

Rate/Salary: $50-$57/HR (DOE)

Inform a friend!

Top