Lead Data Engineer

4 weeks ago

Chennai, India 1HResource Solutions Full time

Location : Chennai.

Shift : 11AM 8 PM or 1PM 10PM.

Skills : Python, Big-Data, spark/pyspark, databricks, ADF or ADL, team management experience.

Role Description :

- As a Technical Lead Big Data Platform, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.

- You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure.

- You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure.

- You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise.

Roles & Responsibilities :

- Designing, developing and maintaining large-scale big data platforms using technologies like Hadoop, Spark and Kafka.

- Creating and managing data warehouses, data lakes and data marts.

- Implementing and optimizing ETL processes and data pipelines.

- Developing and maintaining security and access controls.

- Troubleshooting and resolving big data platform issues.

- Collaborating with other teams to ensure the consistency and integrity of data.

Technical Skills :

Skills Requirements :

- Experience with big data processing technologies such as Apache Hadoop, Apache Spark, or Apache Kafka.

- Understanding of distributed computing concepts such as MapReduce, Spark RDDs, or Apache Flink data streams.

- Familiarity with big data storage solutions such as HDFS, Amazon S3, or Azure Data Lake Storage.

- Knowledge of big data processing frameworks such as Apache Hive, Apache Pig, or Apache Impala.

- Must have excellent communication skills and be able to communicate complex technical information to non-technical stakeholders in a clear and concise manner.

- Must understand the company's long-term vision and align with it.

- Should be open to new ideas and be willing to learn and develop new skills.

- Should also be able to work well under pressure and manage multiple tasks and priorities.

Qualifications :

Qualifications :

- 7-9 years of work experience in relevant field.Tech/B.

(ref:hirist.tech)

  • Director of Data Engineering

    4 weeks ago

    Chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals....

  • Senior Software Engineering Lead

    3 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Director of Data Engineering

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Director of Data Engineering

    4 weeks ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Data Engineering Leader

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Technical Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Crayon Data Engineering Manager Role OverviewCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We're seeking an experienced Engineering Manager to lead our software development team in delivering high-quality, scalable, and secure platforms.Key...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...

  • Lead Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Presidio Full time

    Unlock Your Potential as a Lead Data Engineer at PresidioAre you ready to take your career to the next level? We're seeking a talented Lead Data Engineer to join our team at Presidio, a leading global digital services and solutions provider.About the RoleAs a Lead Data Engineer, you will be responsible for designing, developing, and overseeing data systems...

  • Eucloid - Lead Data Engineer - Python/Azure Databricks

    5 months ago

    Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Role : Lead Data Engineer (Databricks) About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Data Engineering Lead

    3 weeks ago

    Chennai, India Sutherland Global Full time

    Job Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for leading the design, development, and implementation of scalable data solutions that support our analytical and reporting needs.Key Responsibilities:Lead the development and...

  • Data Engineering Lead

    4 weeks ago

    Chennai, Tamil Nadu, India Fluidata Analytics Full time

    Fluidata Analytics is a cutting-edge data and analytics consultancy firm. We are seeking a highly skilled Lead Consultant to manage the delivery of data engineering projects and lead project teams. The ideal candidate should have deep technical expertise in data engineering and extensive experience in managing and delivering complex projects in a timely and...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Selsoftinc Full time

    **Job Title:** Data Engineering Lead**Job Summary:** We are seeking an experienced Data Engineering Lead to lead our big data architecture team. The ideal candidate will have extensive experience in designing and implementing scalable big data architectures on Microsoft Azure and Azure Fabric.**Key Responsibilities:Design and implement scalable big data...

  • Data Engineering Lead

    7 days ago

    Chennai, Tamil Nadu, India Numentica LLC Full time

    Job Title: Azure Data LeadWe are seeking an experienced data professional with a proven track record in designing and implementing data solutions using Azure technologies. The ideal candidate will have over seven years of experience in data engineering, analytics, and architecture.Key Responsibilities:Develop and optimize data pipelines using Azure Data...