Job Description
Position: Data Engineer
Description:
About the job: We are seeking a skilled Data Engineer to contribute to transformative enterprise data platform projects focused on developing data pipelines and logic engines to manage ingest, staging, and multi-tier data product modeling and enrichment using various OEM-specific data warehouse and data lake house platform implementations for consumption via analytics clients.
This role requires full life cycle design, build, deployment, and optimization of data products for multiple large enterprise industry vertical-specific implementations by processing datasets through a defined series of logically conformed layers, models, and views.
Role & Responsibilities: - Collaborate in defining the overall architecture of the solution, including knowledge of modern Enterprise Data Warehouse and Data Lakehouse architectures (Medallion or Lambda architectures).
- Design, develop, test, and deploy processing modules to implement data-driven rules using SQL, Stored Procedures, and Python.
- Understand and own data product engineering deliverables relative to a CI-CD pipeline and standard DevOps practices and principles.
- Build and optimize data pipelines on platforms such as Databricks, Snowflake, SQL Server, or Azure Data Fabric.
Requirements: Hard Skills - Must have: - Current knowledge of using one or more of: Databricks, Snowflake, SQL Server, Azure Data Fabric
- Core experience with data architecture, data integrations, data warehousing, and ETL processes
- Applied experience in SQL, Stored Procedures, and Python based on area of data platform specialization
- Strong knowledge of relational databases: MS SQL Server, PostgreSQL, Oracle, Snowflake, Azure SQL, AWS RDS, Aurora, etc.
- Experience with CICD pipelines, deployment, and integration workflows, including trunk-based development with GitHub Enterprise
Hard Skills - Nice to have: - Proficiency in Python Analytics for advanced data processing
- Experience with DBT and Airflow for rapid model prototyping
Soft Skills / Business Specific Skills: - Ability to identify, troubleshoot, and resolve complex data issues effectively
- Strong teamwork, communication, and intellectual curiosity
- Commitment to delivering high-quality, accurate, and reliable data products solutions
- Willingness to embrace new tools, technologies, and methodologies
- Innovative thinker with a proactive approach
Benefits: Benefits: - Remote work opportunity
- Exposure to modern data platforms and cloud technologies
- Work in cross-functional enterprise-scale teams
- Opportunity for professional growth and learning
- Collaborative and innovative work environment
Job Tags