[Remote] Lead DATA Engineer

Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is a company focused on providing equal employment opportunities. They are seeking a Lead Data Engineer with expertise in Databricks and cloud technologies to design and optimize data pipelines.

Responsibilities

• Experience with Databricks batch processing/data lake design experience
• 3+ yrs hands on expertise in Databricks to design, build, and optimize high throughput batch data pipelines
• 3+ yrs hands-on expertise in Databricks lakehouse architectures on cloud platforms (Azure/AWS)
• Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Scala, Synapse Analytics, Delta Lake, Cosmos DB, or DevOps
• Must have good troubleshooting and problem-solving skills, including debugging multi-threaded applications
• Experience with configuration management and build automation capabilities such as Git/Jenkins
• Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
• Must be able to both collaborate in a team-oriented environment and work independently with direction

Skills

• Experience with Databricks batch processing/data lake design experience
• 3+ yrs hands on expertise in Databricks to design, build, and optimize high throughput batch data pipelines
• 3+ yrs hands-on expertise in Databricks lakehouse architectures on cloud platforms (Azure/AWS)
• Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Scala, Synapse Analytics, Delta Lake, Cosmos DB, or DevOps
• Must have good troubleshooting and problem-solving skills, including debugging multi-threaded applications
• Experience with configuration management and build automation capabilities such as Git/Jenkins
• Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
• Must be able to both collaborate in a team-oriented environment and work independently with direction

Company Overview

Diverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions. It was founded in 2002, and is headquartered in Princeton, New Jersey, US, with a workforce of 1001-5000 employees. Its website is http://www.diverselynx.com.

Company H1B Sponsorship

Diverse Lynx has a track record of offering H1B sponsorships, with 1 in 2024, 1 in 2021. Please note that this does not guarantee sponsorship for this specific role.