Data Engineering Expert for Big Data Solutions

1 day ago


India Cynosure Corporate Solutions Full time

Cynosure Corporate Solutions is seeking a highly skilled Data Engineer to lead our big data solutions team. This role requires expertise in designing, building, and optimizing complex data pipelines using Hadoop/Spark ecosystem.

About the Role:

We are looking for an experienced professional who can work collaboratively with cross-functional teams to deliver high-quality data engineering solutions. The ideal candidate will have a deep understanding of cloud providers such as Azure and AWS, and experience working with various tools like Oozie, Airflow, and Sqoop.

Key Responsibilities:

  • Design and develop efficient data structures and pipelines using Spark/Hadoop ecosystem
  • Collaborate with UI and development teams to deliver end-to-end data engineering solutions
  • Work with clients to understand their data needs and build customized solutions
  • Develop programs for cleaning and processing large datasets
  • Orchestrate jobs using Oozie and Airflow
  • Optimize data pipelines for performance and cost-effectiveness
  • Maintain up-to-date code versioning control and git repository
  • Communicate effectively with internal and external stakeholders about data pipeline designs and implementations

Requirements:

  • Bachelor's degree in Computer Science or related field
  • Minimum 5+ years of experience working with Spark/Hadoop ecosystem
  • Minimum 4+ years of experience designing data streaming pipelines
  • Proven experience with big data ecosystem tools like Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc.
  • Solid experience in all phases of SDLC (plan, design, develop, test, release, maintain and support)
  • Hands-on experience using Azure's data engineering stack
  • Experience implementing projects using programming languages like Scala or Python
  • Working experience on SQL complex data merging techniques like windowing functions
  • Hands-on experience with on-prem distribution tools like Cloudera/Horton Works/MapR

Estimated Salary: $150,000 - $200,000 per year



  • India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...

  • Big Data Engineer

    4 weeks ago


    India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...


  • india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • Lead data engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Lead Data Engineer

    4 weeks ago


    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    4 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...


  • India LTIMindtree Full time

    LTIMindtree is seeking a highly skilled Data Engineering Expert to join our team.Salary: ₹25,00,000 - ₹40,00,000 per annum.Job Description:We are looking for an experienced professional with expertise in designing and developing big data platforms using Scala and Spark.The ideal candidate will have a deep understanding of modern data processing...


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...


  • India Priceline Full time

    Unlock Your Potential in a Fast-Paced Fintech EnvironmentWe are seeking an experienced Data Architect to join our Technology team, where you will play a key role in designing and implementing big data solutions that drive business growth.About the Role:Job Summary:This is a high-level position responsible for leading the design, development, and...


  • India LTIMindtree Full time

    Are you looking for a challenging role in the field of Big Data?We at LTIMindtree are seeking experienced professionals with strong expertise in Spark/Pyspark/Scala Spark/Java Spark skills.About Our CompanyLTIMindtree is a leading global technology consulting and business solutions company that provides innovative, next-generation IT services to its clients...


  • India NCR Voyix Full time

    Senior Big Data Engineer PositionWe are seeking an experienced professional to join our team at NCR Voyix as a Senior Big Data Engineer. This is an exciting opportunity to work with cutting-edge technology and contribute to the development of innovative data products that drive business growth.About the RoleThe successful candidate will be responsible for...


  • india Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Developer

    7 days ago


    India Luxoft Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a key member of our Data Engineering & Analytics team, you will play a crucial role in developing data-driven solutions that drive business growth.About the RoleThis is an exciting opportunity for a seasoned data engineer to leverage their...


  • India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • India NeerInfo Solutions Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at NeerInfo Solutions.About the Role:Proficiency in Azure services: The ideal candidate will have hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake.Programming skills: Strong proficiency in programming...


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...