big data engineer jobs in Hyderabad

Role Responsibilities: Build scalable data pipelines and applications from scratch on AWS Design and manage data ingestion processes and workflows Collaborate with functional and data science teams to deliver data solutions Optimize data storage and organization using HDFS, S3, and Delta Lake Job Requirements: Strong programming experience in Python or...

Title: Sr. Big Data Engineer Location: Hyderabad, Hybrid(Wed and Thursday to be onsite) Intake Notes: • We’re looking for a senior engineer who can architect it, build it, optimize it, and own it in production. • Expert Python + strong SQL • Apache Spark/PySpark, • AWS: Glue, EMR, S3, Step Functions, Athena, Redshift/Spectrum, Lambda, SQS, SNS,...

Core Responsibilities Design and optimize batch/streaming data pipelines using Scala, Spark, and Kafka Implement real-time tokenization/cleansing microservices in Java Manage production workflows via Apache Airflow (batch scheduling) Conduct root-cause analysis of data incidents using Spark/Dynatrace logs Monitor EMR clusters and optimize performance...

Role: Senior Big Data Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: 6+ months Work Schedule: 8 hours/day (Mon-Fri) Location: Hybrid 2x days onsite (Wed/Thur) - Hyderabad, India Job Description We are seeking an experienced Senior Big Data Engineer with 7+ years of expertise in designing, developing, and supporting...

Role: Mid-level Big Data Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: 6 months + extendable Work Schedule: 8 hours/day (Mon-Fri) Location: Hybrid - Wed/Thursday to be in onsite in Hyderabad, India About the role: Design, develop, test, and deploy scalable Big Data solutions on AWS Cloud. Build and maintain batch and...

Coforge is Hiring Big Data Engineers & Big Data Leads. Note: Immediate Joiners Preferred. Coforge Ltd. is looking for experienced Big Data Engineers and Big Data Leads with strong expertise in Spark, Scala, and AWS to join our growing Data Engineering team. Share Your CV: Gaurav.2.Kumar@coforge.com WhatsApp: 9667427662 Experience:- 3 to 10...

Role: Mid-level Big Data Engineer(Java) Position Type: Full-Time Contract (40hrs/week) Contract Duration: 6 months + (extendable) Work Schedule: 8 hours/day (Mon-Fri) Location: Hybrid - Wed/Thursday to be onsite in Hyderabad, India 5+ years of experience is required Java Scala or Python AWS Cloud - strong hands-on

Senior Big Data Engineer - 4916 IT · Development Team Overview Location: hybrid · Hyderabad Employment Type: full time Experience: 7+ years Compensation: INR 1,666,080 - 2,082,600 Overview Senior Big Data Engineer role focused on designing, developing, and supporting large-scale data processing applications on AWS Cloud. The position builds scalable...

TransUnion's Job Applicant Privacy NoticeTeam OverviewAn M02 is responsible for managing a development team, ensuring delivery of software solutions, and aligning execution with business and product goals.The role balances:* People management* Technical oversight* Delivery accountabilityTypically owns a single team of engineers This is a hybrid position and...

Currently we are looking for Bigdata QA test Engineer.ResponsibilitiesRole : Bigdata QA Test EngineerExp : 6+YrsNotice :Immediate to 15 DaysLocation:Hyderabad (Hybrid)Big Data QA/Test engineer – 3 OpeningsHyderabad or Chennai (Hybrid)Big Data QA/Test EngineerAWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test EngineerAWS + Data-bricks + Big...

Role: Snowflake - Data Engineer Location: Hyderabad (BPMLinks) Experience: 5+ Years Timings: US-EST Job Overview: We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience working with modern data tools and cloud platforms, ensuring data integrity,...

𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀 𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟮𝟱𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟯𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟮𝟱-𝟯𝟬 𝗟𝗣𝗔) Experience: 12+...

Company: Finarb Analytics Consulting Pvt. Ltd. Job Title: Data Engineer – SQL Server / Azure Data Factory / Microsoft Fabric Location: Hyderabad or Kolkata, India Experience: 3–6 Years Employment Type: Full-Time Number of Openings: 2 About FinarbFinarb Analytics Consulting is a data, analytics, and technology consulting firm helping organizations...

Responsibilities • Design, build, and maintain data pipelines and engineering workflows • Develop and optimize solutions using SQL, Python, and Databricks • Independently manage and deliver tasks assigned from the project backlog • Support initiatives involving:• Data ingestion, Process automation, transformation • Data quality assurance and...

Dear candidate, Greetings from TCS!!!! TCS invites you for the weekday virtual Interview. Skill: Python,Pyspark,AWS Experience: 6-8 years Location: Hyderabad Required Skills;- Should have working experience: • Development: Python, PySpark & with Spark Framework • Cloud: 2+ years’ experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge,...

**Position:Big Data Engineer (Hadoop & PySpark)** **Experience:** **2 to 5 years** **Location:** **Hyderabad** **Employment Type:** **Full-Time** **Roles & Responsibilities** - Design, develop, and maintain scalable data pipelines using PySpark. - Process and transform large datasets from multiple data sources. - Build and optimize ETL/ELT workflows...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : MicroStrategy Business Intelligence Good to...

Role & Responsibilities: Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. Build streaming and near-real-time data ingestion using Pub/Sub, Dataflow, and CDC where applicable. Implement data...

Nisum is looking for a skilled Data Engineer to join our team. In this role, you'll be responsible for designing and building scalable data pipelines, developing robust data models, and ensuring data quality across our systems. If you're passionate about transforming raw data into actionable insights and enjoy collaborating with diverse teams, we encourage...

Key deliverables: Enhance and maintain the MDM platform Monitor and optimize system performance Troubleshoot and resolve technical issues Support production incident resolution Role responsibilities: Develop and refactor Python and SQL code Integrate REST APIs within MDM workflows Utilize Azure Databricks and ADF for ETL tasks Work on Markit EDM or...