Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
...humbling team environment that not only cares about the people who live here but also those that work here. This position is a CNA/NA who is interested in being a bath aide. The bath aide would work every other Friday, Saturday, Sunday. The total hours every two weeks...
...plan audits, etc. Perform other duties as assigned by management. Minimum Qualifications:~ Bachelors degree in accounting, finance, or relevant major required.~9+ years of experience in accounting, internal audit, and/or finance roles of increasing responsibility...
...design drawings, structural calculations, and other inspection reports for their properties. Combined with BEAR Engineerings archive of reports and open source geotechnical and geological data, you will need to make on the ground observations and apply engineering...
...Specialization: Occupational Medicine Family Medicine... ...Medicine Urgent Care Family Medicine Job... ...Medicine trained physician with an occupational medicine... ...outpatient urgent and primary care An urgent care... ...to three professional sports teams in the NFL, NHL and...
...provide exceptional service and innovative solutions in the hospitality industry. As a leader in our field, we believe in the power of... ...Start your hospitality career with MasterCorp, the leader in housekeeping and hospitality services! Join a team of dedicated, passionate...