Big Data Engineer

---

Job description

• Only qualified Big Data Engineer candidates located near the Irving, TX area to be considered due to the position requiring an onsite presence

Qualifications:

5+ years of experience with Starburst/TRINO, Impala, Hive, SparkSQL

Good knowledge with Hadoop environment and distribution system

Strong data analysis, data evaluation and problem-solving skills

Proficiency in SQL and debugging is crucial

Experiences with writing Python, Pyspark

Identify and troubleshoot data issues and provide timely resolution

Great communication skills to explain technical to non tech team member

Great skills to understand business requirement and convert into tech requirement with action steps

Domain knowledge of data quality/data entitlement is a plus

Agile experience

Responsibilities:

This role is responsible for the delivery of Data Quality rules which includes:

Code & development & enhance SQL Queries

Release the SQL to UAT testing and Prod; Job scheduling and running

Production support - job monitoring and SQL error debugging

Ad hoc python script creation

Hosting meetings and present tech demos

Discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions

Assisting and support analyst team on technical solutions

Understands the SQLs syntax/functions across different analytic engine/platform, responsible to convert Starburst/impala SQL to SparkSQL by referring spark documents and provide optimal query

Works with team members to ensure efforts within owned tracks of work will meet their needs

Communication and documentation

• Only those lawfully authorized to work in the designated country associated with the position will be considered.

• Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.

Benefits:

For information and details on employment benefits offered with this position, please visit here . Should you have any questions/concerns, please contact our HR Department via our secure website .

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here .

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department .

Rose International has an official agreement (ID ), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

<!– job description page –>