Data Engineer in Test (Quality focus)

---

Job description

DRC is one of the largest educational assessment and curriculum/instruction companies in the industry.

Data Engineer (quality focus) - remote/central time zone

Data Recognition Corp - Minnesota

No agencies, please

Company cannot provide sponsorship for this position

SUMMARY:

DRC has more than thirty years of proven experience in reporting and analytics, supporting Educational Technology (EdTech), Federal Research, and Commercial Services. We're committed to being an innovative and disruptive force in the reporting and analytics space as a company. We deliver modern, cloud-based advanced analytics solutions that create value and drive progress. As a company, we embrace a diversity of thought and encourage transparency, accountability, and collaboration to produce the best products and services for our customers.

DRC is continuing to grow and is seeking to add an experienced Data Engineer in quality to join our Data Quality and Delivery organization. In this role, you will work with and across multiple development teams and departments, enterprise stakeholders, and customers and be responsible to help promote the operationalization, quality and reliability of DRC's data delivery pipelines. You will implement, validate, and reconcile key data changes via change management strategies and best practices while delivering high quality BI data reporting and analytic solutions across DRC platforms.

The ideal candidate is a quick learner with strong, demonstrable aptitude in being a versatile SQL scripter and data wrangler who enjoys building, integrating, and managing BI data reporting solutions. This position offers a unique blend of hands-on data engineering and data test engineering skills allowing you to influence how the team finalizes the operationalization and quality of DRC's data delivery pipeline - in support of business and mission critical BI reporting.

RESPONSIBILITIES:

• Implement and configure data/metadata changes and data ETL across various staging and target steps for production data pipelines
• Design and build test data, test strategies, and test plans to verify data transformations, data quality rules, and data integrations
• Complete data validations through detailed comparative analyses of data sets from different sources to ensure data consistency and accuracy
• Perform automated and manual data reconciliation as needed to ensure end-to-end data and BI reporting completeness and fidelity
• Triage, resolve ETL and data/metadata quality issues, performance bottlenecks, and scalability concerns that may arise, pre or post deploy/release
• Document validation scenarios and results, defects, and test coverage in fulfillment of data governance and compliance requirements
• Contribute to team's requirements and gap analyses, work plannings, and deployment orchestrations concerning data quality and reporting deliveries
• Apply and build upon your experiences in data engineering, data quality management, and data validation best practices

QUALIFICATIONS:

• 3+ years of related experience
• Ability to communicate requirements and details to non-technical users
• Comfortable with collaboration and working in a fast-paced environment
• Solid understanding of relational database fundamentals, SQL, data engineering and coding for various database technologies (such as: MS SQL Server, PostgreSQL, Redshift, DynamoDB, Snowflake, etc.) and methodologies (such as: Relational, Star Schema, NoSQL/XML/JSON, etc.)
• Building, optimizing database queries and models
• Building processes that automate/support data transformations, validations and workload orchestrations
• Familiarity with Shell scripting (such as: Unix Bash, Microsoft PowerShell, etc.)
• Ability to review and understand business requirements
• Ability to review and create detailed technical documentation
• Proficient in creating business process and data flow diagrams using tools (such as: MS Visio and LucidCharts).
• Familiarity with Microsoft Office, Atlassian, Google suite, and applicable data analytics tools.

PREFERRED EXPERIENCE (nice to have, not required):

• Familiarity with Web scripting spanning one or more of: HTML, CSS, JavaScript, DevExtreme, HighCharts, etc.
• Familiarity with programming in one or more of the following: Python, Java, C#/.NET, VB.NET, R
• Understanding Web Services / REST / GraphQL core concepts
• Experience working with, configuring or administering BI reporting platforms such as: ThoughtSpot, Tableau, Power BI, Domo, etc.
• Working with cloud technologies such as AWS, Azure, Google Cloud
• Familiarity with Agile development methodologies, such as: Kanban, Scrum
• Understanding of test-driven development and CI/CD deployment pipeline
• Experience with Open Source work management tools such as: JIRA, Jenkins, and GitHub
• Experience scripting for API integration testing eg. with Postman
• Bachelor's or higher degree, preferably in Information Systems, Computer Science, Mathematics, Physics, Engineering or a related discipline
• Central time zone is preferred

ESSENTIAL JOB REQUIREMENTS:

• Excellent organizational, oral, written, and presentational communication skills to work with all levels of staff and management.
• Relate effectively and work respectfully with diverse workgroups.
• Ability to consistently perform well during times of increased workload.
• Set and meet deadlines.
• Manage multiple job functions simultaneously.
• Other duties as needed.

DRC retains the right to change or assign other duties to this position

No Agencies, Please

Company cannot provide sponsorship for this position

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Data Recognition Corporation is an Affirmative Action/Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

<!– job description page –>