Data Engineer
2 weeks ago
Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / Databricks
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussions with client architect and team members
- Orchestrate the data pipelines in the scheduler via Airflow
Skills and Qualifications :
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.
- Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.
- Deep understanding of Star and Snowflake dimensional modeling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL and Spark (PySpark)
- Experience in building ETL / data warehouse transformation processes
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail.
-
Senior Data Engineer
4 days ago
Pune, India Data Axle Full timeJob DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...
-
Senior Data Engineer
1 month ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Senior Data Engineer
2 weeks ago
pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Azure Data Engineer
2 weeks ago
Bangalore/Chennai/Pune/Kolkata/Gurgaon/Gurugram, India Pylon Management Consulting Full timePrimary Roles and Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...
-
Data Engineer
1 month ago
Gurgaon,Gurugram, India E-Qube Digital Services Full timePosition Summary :- Data Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. - They are accountable for guaranteeing compliance with data governance, data privacy, and data security requirements.- Data Engineers are also responsible for the Enterprise...
-
Data Engineer
4 weeks ago
Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Chennai, IN VIDPRO CONSULTANCY SERVICES Full timeMandatory Skills : Snowflake/Azure Data Factory/ PySpark / DatabricksPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development...
-
Azure Data Engineer
2 weeks ago
Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...
-
Azure Data Engineer
2 weeks ago
Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, India VIDPRO CONSULTANCY SERVICES Full timePrimary Roles and Responsibilities: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...
-
Senior Data Scientist
1 month ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Senior Data Scientist
2 weeks ago
pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...
-
Azure Databricks Engineer/Data Engineer
2 weeks ago
Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, India Pylon Management Consulting Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Triage issues to find gaps in existing pipelines and fix the issues- Work with business to understand the need in reporting layer and develop data...
-
OfBusiness - Data Engineer - Data Pipeline
2 days ago
Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full timeWe are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...
-
OfBusiness - Data Engineer - Data Pipeline
2 days ago
Gurgaon/Gurugram, India OFB Tech Pvt Ltd (OfBusiness) Full timeWe are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...
-
Data Engineer
4 weeks ago
Gurgaon/Gurugram/Bangalore, IN Huquo Full timeRole and Responsibilities :- To work on Data Governance - Build a robust data quality validation framework, business rules to identify any data quality issues.- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the data- Build ETL & data pipelines to help feed the data into different business facing data products /...
-
Data Engineer
1 month ago
Gurgaon,Gurugram,Bangalore, India Huquo Full timeRole and Responsibilities :- To work on Data Governance - Build a robust data quality validation framework, business rules to identify any data quality issues.- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the data- Build ETL & data pipelines to help feed the data into different business facing data products /...
-
Data Engineer
2 weeks ago
Bangalore/Gurgaon/Gurugram, IN Intuitive Apps Full timeKey Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, DatabricksJob Description :- Create and maintain optimal data pipeline architecture- Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.- Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet functional /...
-
Data Engineer
2 weeks ago
Bangalore/Gurgaon/Gurugram, India Intuitive Apps Full timeKey Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, Databricks Job Description : - Create and maintain optimal data pipeline architecture - Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required. - Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet...
-
Specialist Data center operations
4 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Specialist Data center operations
4 weeks ago
Kolkata, India NTT DATA Full timeThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...
-
Aptus Data Labs
4 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...