Please scroll down, To apply
Senior Data Engineer/Manager
Takeda
2024-11-05 09:41:07
Springfield, Illinois, United States
Job type: fulltime
Job industry: I.T. & Communications
Job description
By clicking the "Apply" button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda's Privacy Notice and Terms of Use . I further attest that all information I submit in my employment application is true to the best of my knowledge.
Job Description
Senior Data Engineer/Manager
Bannockburn, IL
Hybrid
Job Description
OBJECTIVES/PURPOSE
- The Senior Data Engineer/Manager will enable the success of Plasma-Derived Therapies (PDT) data strategy and Takeda's overall vision by supporting their Line Manager and partnering closely with Data Governance, Platform Engineers, Data Scientists, and other key stakeholders.
- The Senior Data Engineer will:
- Collaborate with different IT functions to develop data models, data ingestion pipelines, and data quality processes that empower business users with real-time decision making capability.
- Serve as a data SME for the business and IT teams in managing a highly complex data ecosystems with thousands of data attributes.
- Build and maintain data systems and datasets that are easy to analyze and support Business Intelligence requirements, as well as downstream systems.
- Create, maintain, and enhance data platforms and infrastructure that enables the analytics front-end; this includes the testing, maintenance, construction, and development of architectures such as high volume, large scale data processing and databases with proper verification and validation processes.
- Collaborate as a trusted advisor and partner to Business teams by improving data models that feed Business Intelligence tools and dashboards, increasing data accessibility, and fostering a culture of data-driven decision making across the organization.
- Develop and maintain scalable data pipelines and build out new integrations using technologies such as Databricks lakehouse and AWS to support continuing increases in data source, volume, and complexity.
- Implement processes and systems to drive data reconciliation and monitor data quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes that depend on it.
- Write unit/integration/performance test scripts and perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Work closely with:
- Team of front-end and back-end Engineers, Product Managers, and Analysts
- Enterprise Teams to design and develop data integration patterns/solutions and data models to support different data and analytics use cases.
- DevOps Teams to deploy data pipeline solutions in Takeda AWS environments that meet security and performance requirements.
- Data Governance team to maintain data quality
- Data Science team to provide the necessary data to drive models and insights
Technical/Functional (Line) Expertise
- Advanced experience and understanding of data lakehouse , data integration, data model, data catalog, data warehouse/mart, RDBMS and other modern database (Graph, No-SQL, etc.) query languages, ETL (IICS), AWS technologies ( AWS DMS, AWS Lambda AWS SQS, AWS Step Functions, AWS EventBridge, AWS RDS Aurora, AWS Kinesis), Scheduling (Tidal/AirFlow), Databricks platform(Sprak structured-streaming, delta tables, unity catalog), Visualization (PowerBI/Tableau), Data streaming platform (Kafka), etc.
- Working hands-on knowledge in various function/object-oriented scripting languages (i.e., Python with Pyspark, SQL, Java/Scala )
- Deep technical knowledge in DevSecOps processes (CI/CD, testing, release mgt, change mgt) and tools (GitHub Actions, Cloudformation/Terraform, SonarCloud, JFrog Artifactory) Strong business acumen with knowledge of the Pharmaceutical, Healthcare, or Life Sciences sector is preferred, but not required.
- Ability to build processes that support data transformation, workload management, data structures, dependency, and metadata.
- Ability to build and optimize queries (SQL), data sets, lakehouse 'Big Data' pipelines, and architectures for structured and unstructured data.
- Experience with or knowledge of Agile Software Development methodologies.
- Strategic mindset of thinking above the minor, tactical details and focusing on the long-term, strategic goals of the organization.
- Advocate of a culture of collaboration and psychological safety.
- Shift from manual decision-making to data-driven, strategic decision-making.
- Proven track record of applying critical thinking to resolve issues and overcome obstacles.
- Proven track record of collaboration and developing strong working relationships with key stakeholders by building trust and being a true business partner.
- Demonstrated success in collaborating with different IT functions, contractors, and constituents to deliver technical solutions that meet Takeda technology standards and security measures.
- Passion for re-imagining new solutions, processes, and end-user experience by leveraging digital and disruptive technologies and developing advanced data and analytics solutions.
- Advocate of a culture of growth mindset, agility, and continuous improvement.
- Supporting PDT Functions in Americas, and Europe.
- High multicultural sensitivity in order to be effective.
- Ability to achieve results through remote collaboration.
Essential
- Bachelor's degree in Engineering, Computer Science, Data Science, or related field. At least 7 years of experience
- Experience designing, building, implementing, and maintaining data and system integrations using REST web services/API, as well as schema design, dimensional data modeling, and development and optimization of ETL pipelines.
- Demonstrated understanding and experience using:
- Data lake Software and Big Data tools (i.e., Kafka, Spark, Databricks and Hadoop)
- Relational NoSQL and SQL databases including Postgres and Graph
- AWS cloud services (i.e., AWS DMS, AWS Lambda, AWS SQS, AWS Step Functions, AWS EventBridge, AWS RDS Aurora, AWS Kinesis, AWS EC2, AWS IAM)
- Databricks platform (i.e. cluster management, job management, unity catalog) knowledge and data stream processing systems (i.e., Spark-Structured Streaming, Delta Tables, DLTs,)
- Batch processing and ETL (IICS, Databricks micro-batch)
- Object function/object-oriented scripting languages (i.e., Python with Pyspark, SQL, Java)
- DevSecOps processes (CI/CD, testing, release mgt, change mgt) and tools (GitHub Actions, Cloudformation/Terraform, SonarCloud, JFrog Artifactory) Strong organizational skills with the ability to manage multiple projects simultaneously and operate as a leading member across globally distributed teams to deliver high-quality services and solutions.
- Excellent written and verbal communication skills, including storytelling and interacting effectively with multifunctional teams and other strategic partners.
- Strong problem solving and troubleshooting skills.
- Experience working with onshore-offshore model and managing deliverables
- Ability to work in a fast-paced environment and adapt to changing business priorities.
- Master's Degree in Engineering, Computer Science, Data Science, or related field.
- Experience in AI, machine learning and data science
- Experience in a global working environment.
Travel Requirements
- Access to transportation to attend meetings.
- Ability to fly to meetings regionally and globally.
- Position may be eligible for alternative work locations dependent upon team dynamics.
- Comprehensive Healthcare: Medical, Dental, and Vision
- Financial Planning & Stability: 401(k) with company match and Annual Retirement Contribution Plan
- Health & Wellness programs including onsite flu shots and health screenings
- Generous time off for vacation and the option to purchase additional vacation days
- Community Outreach Programs and company match of charitable contributions
- Family Planning Support
- Flexible Ways of Working
- Tuition reimbursement
At Takeda, we are transforming patient care through the development of novel specialty pharmaceuticals and best in class patient support programs. Takeda is a patient-focused company that will inspire and empower you to grow through life-changing work.
Certified as a Global Top Employer, Takeda offers stimulating careers, encourages innovation, and strives for excellence in everything we do. We foster an inclusive, collaborative workplace, in which our teams are united by an unwavering commitment to deliver Better Health and a Brighter Future to people around the world.
This position is currently classified as "hybrid" in accordance with Takeda's Hybrid and Remote Work policy.
Takeda Compensation and Benefits Summary
We understand compensation is an important factor as you consider the next step in your career . click apply for full job details
<!– job description page –>