Job Description

Senior Engineer (Spark/AWS) | Hybrid | Contract/W2 Only!

*There are no Corp-to-Corp options or Visa Sponsorship available for this position*

Optomi, in partnership with a market leader in the entertainment industry, is seeking a Senior Engineer for a hybrid position out of one of their hub locations. This candidate will join the Discovery, Merchandising, and Experimentation Data team that owns and operates mission-critical data products and services that enable personalized experiences, content campaigns, and A/B testing across a suite of streaming platforms. The ideal candidate will possess a strong technical background in large-scale data engineering and a passion for designing scalable, high-impact data systems. Additionally, this candidate will collaborate with cross-functional partners to solve complex data problems, build new greenfield solutions, and help drive innovation in experimentation and personalization.

What the right candidate will enjoy:

• Flexible work schedule!
• Long-term career opportunity!
• Contributing to building data products and services from the ground-up!
• Gaining experience with cutting-edge technologies on enterprise-level platforms!

Experience of the right candidate:

• Bachelor’s degree in Computer Science, Engineering, or a related field, plus 5+ years of relevant industry experience.
• Proficiency in Scala or Python, with solid programming fundamentals and experience building production-grade systems.
• Strong experience with Apache Spark, Databricks, and Airflow.
• Solid understanding of data modeling techniques and best practices.
• Familiarity with orchestration frameworks and distributed data processing systems such as Spark, Hadoop, and Databricks.
• Working knowledge of data warehouse solutions, including Databricks and Snowflake, and the ability to evaluate trade-offs among technologies.
• Excellent analytical, problem-solving, and communication skills with a strong attention to detail.

Preferred Qualifications:

• Experience preparing data for machine learning pipelines and personalized recommendation systems.
• Familiarity with A/B testing frameworks, multi-armed bandits, or other experimentation methodologies.
• Hands-on experience with AWS, Java, Kotlin, Typescript, and/or Snowflake in production environments.

Responsibilities of the right candidate:

• Design and develop scalable data products and services supporting personalization, content discovery, and experimentation at petabyte scale.
• Collaborate with stakeholders to understand business needs and translate them into technical solutions in the data and experimentation space.
• Build and maintain robust data pipelines and orchestration frameworks using technologies such as Spark, Airflow, and Databricks.
• Ensure system reliability and performance to meet SLAs and support critical business operations.
• Create and maintain comprehensive documentation to support data quality, data governance, and reproducibility.
• Contribute to agile development practices to continuously improve team processes and delivery.

Tech Stack:

• Languages: Scala, Python, Java, Kotlin, Typescript
• Technologies: Databricks, Spark, Airflow, Snowflake, AWS

Job Tags

Similar Jobs