Note: The job is a remote job and is open to candidates in USA. Pipe Recruit is seeking a Senior Data Engineer to join their team. The role involves migrating and optimizing data models as well as ensuring the integration of BI tools within a new infrastructure.
Responsibilities
- Migrate and Refactor Data Models: Convert and optimize dbt models from Redshift and Snowflake to Trino (Iceberg), ensuring compatibility and performance
- SQL Syntax Conversion: Fix SQL syntax differences between Redshift, Snowflake, and Trino
- Data Modeling: Refactor and optimize data models to align with modern best practices for Iceberg
- BI Integration: Work with Tableau assets to ensure data sources align with the new infrastructure
- Collaboration: Partner with engineering and analytics teams to validate and test migration impacts
- Version Control: Use Git to version control dbt models and ensure seamless deployments
- Daily Standups: Participate in agile workflows to prioritize and execute migration tasks efficiently
Skills
- Bachelors degree in Computer Science, Information Systems, Mathematics, or a related field (or equivalent experience)
- 3+ years in data engineering, BI, or analytics
- 2+ years in financial services or SaaS
- Hands-on experience with dbt (Data Build Tool) and modern data modeling practices
- Strong proficiency in SQL (Redshift, Snowflake, Trino/Iceberg)
- Experience with BI tools like Tableau
- Familiarity with Git for version control
- Knowledge of Jinja templating and macros in dbt
- Strong communication skills to guide teams through infrastructure changes
- Pragmatic approach to balancing speed and accuracy in data solutions
- Experience working in startup environments
- Familiarity with agile methodologies
Company Overview