Data Engineer and Big Data Specialist

3 days ago


Chennai, Tamil Nadu, India myGwork Full time

About Us

myGwork is an inclusive employer and a member of the largest global platform for the LGBTQ+ business community. Our company is all about innovation and pushing boundaries.

Job Title: Data Engineer and Big Data Specialist

Location: Amazon, USA (Note: Location may vary based on the actual requirement)

Estimated Salary: $140,000 - $200,000 per year

About the Role

We are seeking a highly skilled Data Engineer and Big Data Specialist to join our DISCO team at Amazon Music. As a key member of our team, you will be responsible for designing, building, and maintaining big data pipelines using various technologies such as Redshift, S3, EMR, and Spark.

Key Responsibilities

  • Design and develop scalable big data pipelines using Hadoop, Hive, and Spark.
  • Maintain and optimize existing data pipelines to ensure high performance and availability.
  • Collaborate with cross-functional teams to gather requirements and provide technical expertise for data-related projects.
  • Develop and implement data models, ETL processes, and data quality checks to ensure accurate and timely data delivery.
  • Participate in code reviews, provide feedback, and mentor junior engineers to improve overall team performance.

Requirements and Qualifications

  • 2+ years of experience in data engineering, big data technologies, and related fields.
  • Strong knowledge of Hadoop, Hive, Spark, and other big data technologies.
  • Experience with SQL, Unix, and scripting languages such as Python or KornShell.
  • Familiarity with distributed systems, data storage, and computing.
  • Excellent problem-solving skills, attention to detail, and ability to work in a fast-paced environment.

Bonus Points

  • Experience with ETL tools like Informatica, ODI, SSIS, BODI, Datastage, etc.
  • Knowledge of AWS services such as Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda.

Why Join Us?

At myGwork, we value diversity, equity, and inclusion. We offer a dynamic work environment that fosters growth, innovation, and teamwork. If you're passionate about big data, data engineering, and making a difference, we'd love to hear from you


  • Big Data Specialist

    2 weeks ago


    Chennai, Tamil Nadu, India Onward Technologies Limited Full time

    **Job Title:** Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to join our dynamic team at Onward Technologies Limited. As a Big Data Specialist, you will play a pivotal role in designing, developing, and implementing robust cloud-based data solutions.**Key Responsibilities:Implement data security and compliance measures to protect...


  • Chennai, Tamil Nadu, India ANRI Solutions HR Services Full time

    At ANRI Solutions HR Services, we are looking for a highly skilled Big Data Engineering Specialist to lead our data engineering efforts. The ideal candidate will have extensive experience in Spark and Scala, with a strong background in creating end-to-end data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Spark and...


  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    Job Title: GCP Big Data SpecialistWe are hiring a skilled GCP Big Data Specialist to join our team in Chennai. As a GCP Big Data Specialist, you will be responsible for designing, developing, and maintaining data pipelines and data warehouses on Google Cloud Platform (GCP).About the Role:Data Engineering: Design, develop, and maintain data pipelines using...

  • Big Data Specialist

    1 week ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    About UsLTIMindtree is a global technology consulting and services company that helps clients achieve business value by harnessing the power of technology.Estimated Salary:$120,000 - $180,000 per annum, depending on experience and location.Job DescriptionWe are seeking an experienced Big Data Specialist to join our team. As a key member of our analytics...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Data Management Specialist**Overview**We are seeking an experienced Data Management Specialist to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • Chennai, Tamil Nadu, India Truetech Full time

    Big Data Optimization SpecialistAre you passionate about optimizing data solutions? Truetech is looking for a skilled Big Data Optimization Specialist to join their team. In this role, you will be responsible for designing and implementing optimized data workflows using big data technologies like Apache Spark, Kafka, and Hadoop tools. Your expertise will...

  • Big Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Big Data EngineerCompany Overview: LTIMindtree is a leading digital transformation consulting and technology services company, seeking an experienced Big Data Engineer to join our team.Salary: The estimated annual salary for this position is around $120,000-$180,000, depending on location and experience.Job Description: As a Big Data Engineer at...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data EngineerTata Consultancy Services is seeking a skilled Big Data Engineer to join our team. As a leading global consulting and IT services company, we empower our clients to become digital businesses.The estimated salary for this role is ₹1,200,000 - ₹2,500,000 per annum, based on location and experience.About the Role:We are looking...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India MNR Solutions Full time

    About UsMNR Solutions is a leading technology firm with a strong presence in Bangalore and Chennai, India. Our company culture values innovation and collaboration, making us an ideal place for talented professionals to grow.Job SummaryWe are seeking an experienced Data Engineer to join our dynamic team as a Big Data Solutions Specialist. The successful...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About the RoleWe are a global leader in the technology arena, and we're looking for a skilled Big Data Cluster Specialist to join our team.


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    About the RoleCynosure Corporate Solutions is looking for a talented Big Data Pipeline Specialist to join our team.This is an exciting opportunity to work with cutting-edge technologies such as Azure and Spark. The successful candidate will have hands-on experience with cloud providers, data ingestion and integration pipelines, and code versioning control.We...


  • Chennai, Tamil Nadu, India Softpath Technologies LLC Full time

    Job Title: Data Engineer SpecialistThe ideal candidate will be responsible for monitoring, maintaining, and optimizing our data ingestion pipelines to ensure the efficient flow and processing of data across various systems. This role requires a strong foundation in Big Data concepts, SQL, and data pipeline operations, as well as the ability to collaborate...


  • Chennai, Tamil Nadu, India myGwork Full time

    About the RoleAs a highly skilled Big Data Architectural Specialist at myGwork, you will be responsible for designing and implementing cutting-edge data solutions that drive business growth and customer satisfaction. This is an excellent opportunity to join our team of innovators who are passionate about harnessing the power of big data to create meaningful...


  • Chennai, Tamil Nadu, India Nextgen Creation Inc Full time

    Job Title: Data Engineer SpecialistWe are seeking a highly skilled Data Engineer Specialist to join our team at Nextgen Creation Inc in Chennai, India. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.About the Role:We are looking for a seasoned professional...


  • Chennai, Tamil Nadu, India LTIMindtree Full time

    At LTIMindtree, we are seeking a skilled Big Data Developer to join our team.About the RoleWe are looking for an experienced professional with a strong background in Big Data technologies, particularly Scala and Spark. The ideal candidate will have hands-on experience working with real-time streaming data using Kafka.The successful candidate will also have...

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job DescriptionLTIMindtree is seeking an experienced Big Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesDesign and develop scalable data pipelines using Apache SparkWork with Kafka to implement real-time...

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global consulting and IT services company that requires highly skilled professionals to join its team.We are seeking a talented Big Data Engineer to work with us in our Chennai location. The successful candidate will have the opportunity to work on various projects, leveraging their skills in data analysis, machine...


  • Chennai, Tamil Nadu, India C2E Consultancy Full time

    Data Engineering Specialist Job Description:We are seeking an experienced Data Engineering Specialist to join our team at C2E Consultancy.The successful candidate will have a strong background in data engineering, with expertise in Apache Spark or Hadoop.This is a long-term opportunity that requires a high level of technical expertise, excellent...


  • Chennai, Tamil Nadu, India Wipro Ltd Full time

    About the RoleWipro Ltd is seeking an experienced Data Engineer to join our team. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.You will work closely with our architect to design secure and scalable solutions that meet the needs of our business. Additionally, you will be...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Overview:We are seeking a highly skilled Senior Big Data Engineer to join our team at Tata Consultancy Services in Chennai. This is an exciting opportunity for a seasoned professional to leverage their expertise in big data processing, storage, and analytics to drive business growth and innovation.About the Role:As a Senior Big Data Engineer, you will be...