Data Engineer with Security Clearance

---

Job description

Job Title: Senior Data Engineer
Location: Hybrid (Oakland, CA)
Job Type: Full-Time Job Description
We are seeking a highly skilled Senior Data Engineer with experience in designing, implementing, and optimizing database solutions, ensuring robust data flow, managing data pipelines, enhancing data process efficiencies, and building systems to collect, manage, and transform raw data into actionable insights. You will work closely with our engineering and data teams to diagnose bottlenecks, implement enhancements, and create a seamless data ecosystem. The ideal candidate will have a strong background in SQL and cloud infrastructure, with the ability to optimize data storage, visualization, and analytics over long periods of time. This role offers an exciting opportunity to be at the forefront of technological innovation, working with cutting-edge systems in a collaborative and dynamic environment. If you are a driven and skilled engineer looking to make a significant impact in advanced manufacturing and the green energy transition, we encourage you to apply. Key Responsibilities:
• Database Performance Tuning: Analyze and optimize database performance by identifying bottlenecks and implementing best practices for indexing, query optimization, and schema design.
• Database Design and Architecture: Collaborate with stakeholders to design and implement efficient database architectures that meet business requirements and ensure scalability. Optimize data storage and compression techniques to maximize efficiency and minimize costs
• SQL Query Optimization: Rewrite and optimize SQL queries to improve execution times and reduce resource consumption, ensuring efficient data retrieval and manipulation.
• Monitoring and Observability: Utilize observability tools like Prometheus and Grafana to monitor database performance metrics, set up alerts, and create dashboards for real-time insights.
• Data Visualization: Design and implement data visualization tools and dashboards to provide insights into large datasets
• Data Serialization and Investigation. Utilize expertise in network protocols, specifically Protocol Buffers, to facilitate efficient data serialization and communication between services.
• Data Integrity and Security: Ensure data integrity and security by implementing appropriate access controls, backup strategies, and compliance measures.
• Collaboration with Development Teams: Work closely with software development teams to integrate database solutions with applications, ensuring seamless data flow and application performance.
• Client Support: Work closely with clients to provide support in best practices and project and data management
• Documentation and Best Practices: Document database designs, optimization strategies, and maintenance procedures to facilitate knowledge sharing and adherence to best practices.
• Continuous Improvement: Stay updated with the latest database technologies and trends, and proactively recommend improvements to enhance database performance and reliability. Qualifications
• Bachelor's (or higher) degree in Computer Science, Engineering, or a related field
• 10+ years of industry experience, 7+ years working with data-intensive applications
• Proven experience as a Data Engineer or similar role
• Proven experience with data-intensive application development and is up to speed on the best tools for the jobs
• Proficiency in Python (Java/Scala/R/Rust is a plus)
• Strong proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, Oracle)
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
• Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake)
• Knowledge of data compression techniques and data visualization tools (e.g., Tableau, Power BI, Plotly)
• Hands-on experience with observability tools, specifically Prometheus and Grafana.
• Strong understanding of network protocols, especially Protocol Buffers
• Familiarity with data engineering frameworks and tools (e.g., Apache Kafka, Apache Airflow).
• Knowledge of machine learning and data analytics concepts
• Excellent communication and collaboration skills
• Ability to work independently and in a team environment What We Offer
• Base Salary: $120k/year to $160k/year
• Stock Options
• Health, Dental, Vision, and 401k

<!– job description page –>