Data Engineer
2 months ago
Job Description :
About the Role :
We are searching for a skilled Data Engineer to join our team and play a key role in managing our data transformation and integration pipelines. This role focuses on ensuring the smooth operation and optimization of our DBT, Airflow, and Python environment to meet the organization's data needs. The ideal candidate will be a data engineering expert with experience in Airflow, Python, and ideally, DBT.
Responsibilities :
- Configure, administer, and optimize the DBT, Airflow, and Python platform for data integration, transformation, and loading (ETL) tasks.
- Develop and maintain data pipelines using Airflow and Python to automate data processing workflows.
- Utilize DBT to manage data models and transformations (a plus).
- Leverage Snowflake and AWS services like Glue and Lambda for data storage and processing (a plus).
- Troubleshoot and resolve issues within the distributed data processing systems.
- Collaborate with the data science and engineering teams to ensure data pipelines align with technical and business requirements.
- Translate architectural solutions into efficient and robust data pipelines.
- Continuously monitor and improve the performance and scalability of the data pipelines.
- Work within an agile development framework and participate in scrum ceremonies.
Qualifications :
- 5+ years of experience in Data Engineering with expertise in data pipelines and orchestration tools.
- Proven experience with Apache Airflow and Python for data processing and workflow automation.
- Strong understanding of data engineering principles, including data modeling, ETL processes, and data quality.
- Familiarity with DBT (a plus). Experience with Snowflake and/or AWS data services (Glue, Lambda) a plus.
- Excellent problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Experience working in an agile environment and participating in scrum ceremonies.
(ref:hirist.tech)-
Senior Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
Sr data engineer
3 days ago
bangalore, India NTT DATA Services Full timeReq ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer ...
-
Sr data engineer
17 hours ago
Bangalore, India NTT DATA Services Full timeReq ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data...
-
Bangalore, India NTT DATA Services Full timeAzure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...
-
Data Architect
4 weeks ago
bangalore, India NTT DATA Full timeJob Description : Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data...
-
Data Engineer
1 month ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Aptus Data Labs
2 months ago
bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Aptus Data Labs
2 months ago
Bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Data Engineer
4 weeks ago
Bangalore, India NTT DATA Services Full timeData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...
-
Data Engineer
1 month ago
bangalore, India NTT DATA Services Full timeData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...
-
Data Architect
3 weeks ago
Bangalore, India NTT DATA Services Full timeReq ID: 281978 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...
-
Data Architect
4 weeks ago
Bangalore, India NTT DATA Services Full timeReq ID: 281978 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...
-
Data Architect
4 weeks ago
bangalore, India NTT DATA Services Full timeReq ID: 281978 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description: Data...
-
Staff Engineer
3 weeks ago
bangalore, India Hevo Data Full timeAbout Hevo Data: Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping the...
-
Solutions Engineer
8 hours ago
bangalore, India Hevo Data Full timeAbout HevoHevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies share one thing. They all use Hevo Data’s fully managed Automated Pipelines to consolidate their data...
-
Solutions Engineer
1 day ago
bangalore, India Hevo Data Full timeAbout Hevo Hevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies share one thing. They all use Hevo Data’s fully managed Automated Pipelines to consolidate their...
-
Digital Engineering Sr. Engineer
3 weeks ago
bangalore, India NTT DATA Full timeJob Description Req ID: 274457 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA),...