Senior Data Engineer
3 weeks ago
Basic Functions:
We are seeking a skilled and motivated Data Engineer to join our Data Solutions team that is focused on the development, maintenance, and optimization of our data infrastructure. The team specializes in data modeling and Power BI report development to support the objectives of our business stakeholders. The Senior Data Engineer is a core member of the team responsible for providing solutions to digital age data challenges through design and implementation of an ecosystem of Cloud solutions to support AI, Machine Learning and other modern data technologies. This role will be responsible for designing, developing, optimizing, standardizing data engineering pipelines along with creating robust data models for data publishing while complying with, and adding value to, the data architecture. The Data Engineer will also be responsible for guiding the existing data engineering team and developing cloud-native solutions with low time to market by leveraging DevOps methodologies. This individual will evangelize and implement the modern practices in data engineering that address scale and are essential for digital transformation through high-value-driven projects.
Roles & Responsibilities:
- Work closely with data scientists, platform engineers, data architects, and data source owners to deliver foundational data sets, enabling analytics solutions driving successful business outcomes.
- Provide leadership in designing and implementing best practices for efficient sourcing and processing large data sets from Analytics data stores.
- Build real-time, reliable, scalable, high performing, distributed, fault tolerant systems.
- Design and develop code, scripts and data pipelines that leverage structured and unstructured data.
- Implement measures to address data privacy, security, compliance and ensure robust data governance.
- Industrializing data lakes or real-time platforms for an enterprise enabling business applications and usage at scale
- Monitor, maintain and optimize production systems. Investigate and resolve incidents reported by users. Identify opportunities to automate, consolidate and simplify platforms.
- Work with Enterprise Architecture, Digital, and other IT teams to develop and maintain data integrity, integration and governance standards.
- Guide business stakeholder and mentor members of the data and analytics teams regarding technology and best practices.
- Manage assigned activities within time, cost and technical objectives. May manage small projects with internal or external resources.
Minimum Qualifications:
Education
Bachelor's degree in computer science, Information Systems, Business Administration or a related discipline
Work Experience
Min. Qualifications
- 8+ years hands-on experience in architecting, developing, and successfully operationalizing complex/large scale data management projects
- Experience in data warehouse and ETL design and development using SQL on RDBMS and MPP databases
- Experience in development on Cloud (PaaS) Data Solutions, Azure preferred
- At least 3-5 years experience in Python, and ideally also in Java, SQL, or Scala
- At least 3-5 years experience with SnowFlake
- At least 3-5 years of experience in MS PaaS data services (examples include Azure data factory, Azure data lake store, Azure function apps, Azure SQL/ Data Warehouse, etc.)
- At least 3-5 years of experience in developing, designing, and deploying end to end batch / real-time solutions.
Preferred Qualifications:
- Experience securing Cloud based modern data platforms
- Experience building data management (metadata, lineage, tracking etc.) and governance solutions for modern data platforms
- Experience of working with enterprise common data models in SAP HANA, Azure SQL, manufacturing historians, various IoT, subscription and public data sources.
- Experience of Reporting and Analytics tools such as Tableau, Power BI, and Alteryx
- Experience with global enterprise environment or major consulting firm is a plus.
- DP-200: Implementing an Azure Data Solution
- DP-201: Designing an Azure Data Solution
- SnowPro Core or SnowPro Advanced Certifications
- Microsoft Certified: Azure Data Engineer Associate
-
Senior Data Engineer
2 months ago
Mumbai, Maharashtra, India timesjobs Full timeJOB DETAILSExperience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)Hands-on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline.Excellent...
-
Senior Director – Data Engineering
5 hours ago
Mumbai, India eClerx Full timeJob Title: Senior PGM – Data EngineeringPreferred Location: Mumbai/Pune/Chandigarh/RemoteJob Overview:We are looking for a seasoned Senior Program Manager (PGM) in Data Engineering to lead and manage large-scale data engineering projects that align with our organization’s business goals. The Senior PGM will oversee the strategy, planning, and execution...
-
Senior Director – Data Engineering
35 minutes ago
Mumbai, India eClerx Full timeJob Title: Senior PGM – Data EngineeringPreferred Location: Mumbai/Pune/Chandigarh/RemoteJob Overview:We are looking for a seasoned Senior Program Manager (PGM) in Data Engineering to lead and manage large-scale data engineering projects that align with our organization’s business goals. The Senior PGM will oversee the strategy, planning, and execution...
-
Senior Data Engineer
3 months ago
Mumbai, India PEOPLEOCITY LLP Full timeJobSummary:Asa Senior Data Engineer you will be responsible for creatingeffective technological solutions for work with big data. They arealso responsible for managing a team of specialists in their fieldand related IT professions. In addition their roles include qualitycontrol of the workperformed.PositionSenior Data Engineer 5to...
-
Senior Project Engineer
3 months ago
Mumbai, India NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Senior Data Engineer
3 months ago
Mumbai, India The Nielsen Company Full timeAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...
-
Senior Data Engineer Mumbai
1 month ago
Mumbai, Maharashtra, India Pplanet Full timeApply for Senior Data Engineer Mumbai Apply Pplanet HR Services, Career Progress Consultants in Mumbai for 2 - 3 Year of Experience on
-
Senior Data Engineer
7 days ago
mumbai, India RapidBrains Full timeJob Title : Senior Data Engineer (Java + Azure)Job ID: NIM2S668Experience Required: 8+ YearsLocation: Mumbai, Chennai, GurgaonEmployment Type : FulltimeNotice Period: Immediate to 30 daysJob Description:Key Responsibilities:Map data into common formats, conduct advanced data analysis, validate findings, test hypotheses, and communicate results...
-
Senior Data Engineer
7 days ago
Mumbai, India LyondellBasell Full timeBasic Functions: We are seeking a skilled and motivated Data Engineer to join our Data Solutions team that is focused on the development, maintenance, and optimization of our data infrastructure. The team specializes in data modeling and Power BI report development to support the objectives of our business stakeholders. The Senior Data Engineer is a core...
-
Senior Engineer
3 months ago
Mumbai, India NTT DATA Full timeJob Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...
-
Senior Data Engineer
1 week ago
Mumbai, India RapidBrains Full timeJob Title : Senior Data Engineer (Java + Azure)Job ID: NIM2S668Experience Required: 8+ YearsLocation: Mumbai, Chennai, GurgaonEmployment Type : FulltimeNotice Period: Immediate to 30 daysJob Description:Key Responsibilities:Map data into common formats, conduct advanced data analysis, validate findings, test hypotheses, and communicate results...
-
Senior Data Engineer
7 days ago
Mumbai, India RapidBrains Full timeJob Title : Senior Data Engineer (Java + Azure) Job ID: NIM2S668 Experience Required: 8+ Years Location: Mumbai, Chennai, Gurgaon Employment Type : Fulltime Notice Period: Immediate to 30 days Job Description: Key Responsibilities: Map data into common formats, conduct advanced data analysis, validate findings, test hypotheses, and communicate...
-
Senior Data Engineer
1 week ago
Mumbai, India RapidBrains Full timeJob Title : Senior Data Engineer (Java + Azure)Job ID: NIM2S668Experience Required: 8+ YearsLocation: Mumbai, Chennai, GurgaonEmployment Type : FulltimeNotice Period: Immediate to 30 daysJob Description:Key Responsibilities:Map data into common formats, conduct advanced data analysis, validate findings, test hypotheses, and communicate results...
-
Senior Data Engineer
2 weeks ago
Mumbai, India Informa PLC Full timeJob Description Job Summary: As a Senior Data Engineer , the successful candidate will play a key role in providing support on CDP Implementation and Operation, Data Pipelines creation and maintenance, Reports and Dashboards, and Software Development across Asia countries. Responsibilities: CDP Implementation and Operation Manage creation of...
-
Senior Data Engineer
1 week ago
Mumbai, India Quantiphi Full timeRole : Senior Data EngineerYears of Experience : 3-7 yearsLocation : Mumbai/Bangalore (Hybrid)JOB ROLE - Senior Data Engineer - AWSWe are seeking an experienced and passionate Senior Data Engineer (AWS) to join our dynamic team. In this role, you will play a crucial part in designing and implementing scalable and efficient data solutions on the AWS platform....
-
Senior Data Engineer
1 week ago
Mumbai, India Resourcetree Global Services Full timeA "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms. You lead the construction of datasets requested by various stakeholders, the build and maintenance of the resulting data pipelines. You closely work in collaboration with our data analysts, data scientist and business application...
-
Senior Data Engineer
3 days ago
Mumbai, India smalldata.ai Full timesmalldata.aiis a research and consulting firm, we help businesses unlock value from their data by combining our expertise in data platforms, AI products and our proven foundational data platform "fynd"."Small data connects people with timely, meaningful insights (derived from big data and/or 'local' sources), organised and packaged to be accessible,...
-
Senior Data Engineer
7 days ago
mumbai, India Quantiphi Full timeRole : Senior Data EngineerYears of Experience : 3-12 yearsLocation : Mumbai/Bangalore (Hybrid)Must have skills:3+ years’ of hands-on experience in delivering data solutionsExperience with AWS - S3,Step functions,Glue,Secrets ManagerExperience with Databricks implementationsExperience in implementing data integration projects using ETL (preferably Qlik...
-
Azure Consultant-Data Engineer/Architect
22 hours ago
Mumbai, India Aptus Data Labs Full timeRole : Azure Sr ConsultantExperience: 8+ yrsLocation: Hyderabad/Mumbai(Onsite)Notice- Need resource who can join within 30 daysSkill: Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data factory, Databricks, Pyspark), Azure Cloud, Databases (SQL database), python, infrastructure, network & securityYou can also share your resume...
-
Senior Data Engineer
1 week ago
Mumbai, India Informa Markets Full timeJob DescriptionJob Summary:As a Senior Data Engineer, the successful candidate will play a key role in providing support on CDP Implementation and Operation, Data Pipelines creation and maintenance, Reports and Dashboards, and Software Development across Asia countries. Responsibilities: CDP Implementation and OperationManage creation of master reference...