Data Engineer
3 months ago
Job Title : Data Engineer
Experience : 2-4 Years
Job Location : Pune/Gurgaon
Work Mode : WFO/Hybrid
Mandatory Skills : Managing Model Operations on Dataiku platform
Job Summary :
We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in managing model operations on the Dataiku platform, alongside a strong background in data engineering practices. In this role, you will be responsible for building and maintaining robust data pipelines, ensuring the smooth operation of data models, and optimizing data workflows to drive actionable insights and support business Responsibilities :
Model Operations Management :
- Oversee and manage model lifecycle operations on the Dataiku platform, including deployment, monitoring, and optimization.
- Collaborate with data scientists to integrate and operationalize machine learning models.
- Implement and manage model versioning and rollback procedures.
Data Pipeline Development :
- Design, build, and maintain scalable and efficient data pipelines to support analytics and reporting needs.
- Extract, transform, and load (ETL) data from various sources into Dataiku and other data repositories.
- Optimize data ingestion and processing workflows for performance and reliability.
Platform Optimization :
- Ensure the Dataiku platform is configured for optimal performance, scalability, and security.
- Troubleshoot and resolve platform-related issues, including data integration and processing challenges.
Collaboration & Documentation :
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Document data workflows, model operations, and data pipeline architectures.
- Provide training and support to team members on best practices for using the Dataiku platform.
Quality Assurance :
- Monitor data quality and integrity throughout the pipeline and model lifecycle.
- Implement automated testing and validation procedures to ensure data accuracy and Improvement :
- Stay up-to-date with the latest advancements in data engineering, machine learning, and Dataiku platform features.
- Identify opportunities for process improvements and implement innovative :
Education : Bachelor's degree in Computer Science, Engineering, Data Science, or a related field. Master's degree or relevant certifications is a plus.
Experience :
- Proven experience working with the Dataiku platform, including model deployment and management.
- Strong background in data engineering, including experience with ETL processes, data warehousing, and data integration.
- Hands-on experience with SQL, Python, or other data processing languages.
Skills :
- In-depth knowledge of the Dataiku platform and its features.
- Proficiency in building and managing data pipelines and workflows.
- Strong analytical and problem-solving skills with a focus on data quality and performance.
- Excellent communication skills with the ability to collaborate effectively with cross-functional teams.
Preferred :
- Experience with cloud data platforms such as AWS, Azure, or Google Cloud.
- Familiarity with data modeling, machine learning algorithms, and their application in a business context.
(ref:hirist.tech)-
Data Engineers/Modelers
1 month ago
Gurugram, India NTT DATA Services Full timeData Engineers/Modelers - 8+ years of experience mAnalyticsResponsibilitiesDevelop and implement data pipeline for ingestion , loading and transformation of data sets from other systemsDesign and develop logical and physical data models as per business requirements.Perform data analysis to identify relationships, patterns and trends in dataEnsure data...
-
Digital Engineering Engineer
7 days ago
Gurugram, India NTT DATA Services Full timeReq ID: 295081 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Job Duties: Must have:...
-
Data Engineer
4 weeks ago
gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...
-
Eucloid - Data Engineer - Azure Databricks
5 months ago
Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full timeJob Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...
-
Senior Data Engineer
2 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...
-
Data Engineer
4 weeks ago
gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
4 weeks ago
Gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...
-
Data Engineer
1 month ago
gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...
-
Data Engineer
1 month ago
Gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...
-
Data Engineer
1 month ago
Gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...
-
Data Engineer
4 weeks ago
gurugram, India Turnberry Solutions Full timeExperienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...
-
Data Engineer
4 days ago
Gurugram, India Markovate Full timeJob Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...
-
Data Engineer
5 days ago
Gurugram, India Markovate Full timeJob Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...
-
Data Engineer
5 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
4 months ago
Gurugram, India Siemens Energy Full timeData Engineer About the Role Location India Haryana Gurugram Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Core Full / Part time Full-time Experience Level Experienced Professional A Snapshot of Your Day Data Engineer is an engineering role within a data...
-
Data Engineer
4 months ago
Gurugram, India Circle K Full timeJOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...
-
Data Engineer
4 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
4 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
3 weeks ago
gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
3 days ago
Gurugram, India IGT Solutions Full timeJob Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...