Big Data Engineer

2 days ago

Bengaluru, India People Prime Worldwide Full time

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Title: Senior Data Engineer Location: Hyderabad,Chennai Experience: 6 - 12 years Employment Type: Permanent Notice Period: Immediate Joiners Key Responsibilities: Big Data Processing: Design, develop, and maintain scalable ETL/ELT pipelines using PySpark, Scala, or Java. Implement data transformation workflows to ensure clean and reliable datasets. Cloud Integration: Work extensively with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS to build and manage data solutions. Data Modeling & Optimization: Develop and optimize data models in Hadoop and Spark environments. Ensure performance tuning and cost optimization of cloud-based data platforms. Data Ingestion & Integration: Ingest data from various sources including APIs, RDBMS, and NoSQL databases. Implement data pipelines for batch and real-time processing. Collaboration & Documentation: Collaborate with cross-functional teams to understand data requirements and deliver solutions. Document data models, transformation logic, and technical specifications. Automation & Monitoring: Automate data workflows and ensure data pipelines are reliable, scalable, and error-free. Implement data monitoring, logging, and alerting to ensure pipeline reliability. Required Skills & Qualifications: Technical Expertise: 6–12 years of experience in Big Data engineering with strong hands-on experience in AWS, PySpark, Scala, or Java. Proficiency in SQL and experience with Hadoop ecosystem components like Hive, HDFS, and Kafka. Cloud Services: Extensive experience with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS. Data Engineering Tools: Familiarity with data orchestration tools like Apache Airflow or Oozie. Experience with containerization technologies like Docker and Kubernetes is a plus. Soft Skills: Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Ability to work independently and in a team-oriented environment. Preferred Skills (Good to Have): Certifications: AWS Certified Solutions Architect, AWS Certified Big Data – Specialty, or Cloudera Certified Associate (CCA). Experience with CI/CD pipelines using tools like Jenkins or GitLab. Knowledge of data warehousing concepts and experience with platforms like Redshift or Snowflake. Familiarity with streaming technologies such as Apache Kafka or Kinesis.

  • Big Basket

    6 days ago

    Bengaluru, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India The IT Firm Full time

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions. Mandatory Skill...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Engineer

    4 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Suzva Software Technologies Full time

    Hiring: Big Data Engineer (PySpark)Client: (Details will be shared upon shortlisting)Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Chennai, Noida, India Talodyn Networks Private Limited Full time

    Job Description Data Architecture - Big Data Engineer What does a Data Engineer do As an experienced member of our Data Engineering Platform Group you will be responsible for building and taking ownership over the successful design and development of data engineering projects within Fiserv's Enterprise Data Analytics division. You will be required to...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    2 days ago

    Bengaluru, India People Prime Worldwide Full time

    About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Title: Senior Data...