big data engineer jobs in Chennai

Job Description: BIG Data Engineer   Exp – 6 Yrs to 10 Yrs     Salary Grid – Up to 25 lpa   Job Code - TechM160753   Work Location: Hyderabad / Chennai   Hybrid – Work from Office – 3 Days a week/ 12 days a month    Key Skills – Pyspark, Spark, Python, Hive, SQL   Job Descriptions: -  6+ Year experience as Data Engineer with...

Role: Big Data Developer Experience: 6-10 yrs location: chennai, pune, bengalore Responsibility: • Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting • Should be comfortable with Unix File system as well as HDFS commands • Should have worked on query languages such...

Role: Big Data & Hadoop Ecosystem Developer (MapR) Experience: 5–12 Years Location: Mumbai, Chennai, Hyderabad, Bangalore, Indore Ahmedabad Job Type: Full-Time Job Summary • Design, develop, and maintain big data solutions using the Hadoop ecosystem and MapR platform. • Build scalable ETL/ELT pipelines for structured, semi-structured, and unstructured...

Big data developer/Lead Key Responsibilities: • Data Pipeline Development: Designing, developing, and maintaining data pipelines to efficiently move and transform large datasets from various sources. • System Design and Architecture: Creating the overall architecture of the big data platform and ensuring its scalability, performance, and reliability. •...

BigData Developer Key responsibilities (please specify if the position is an individual one or part of a team): The role requires a hands-on technologist with expertise in Data Engineering with strong programming background in Hadoop/Hive/Sparks/Scala Should have hands-on knowledge on GCP cloud platforms. Role & Responsibilities: 1. Provide technical...

Job SummarySynechron is seeking a Big Data Engineer with 5+ years of experience in designing, developing and deploying scalable and reliable data-processing solutions on AWS using Java and Apache Spark. The role will focus on implementing big data processing pipelines using Apache Spark on AWS EMR, developing and deploying serverless applications using AWS...

Job SummarySynechron is seeking a Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP) to design, develop, and maintain scalable data pipelines.The role is responsible for building reliable data ingestion and transformation processes, working with large-scale datasets, and supporting distributed data-processing environments....

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

We are looking for someone with advanced Python programming skills who applies robust software engineering principles to data problems. You will collaborate closely with Data Scientists, ML Engineers, and Product Managers to build the scalable, automated pipelines required to train, deploy, and monitor machine learning models in...

We are seeking an experienced Data Engineer with 5+ years of hands-on expertise across the modern data stack to design, build, and maintain high-performance ELT pipelines. In this role, you will be the core technical owner of our analytics foundation—leveraging Snowflake, dbt, hosted on cloud infrastructure (AWS, Azure, or GCP). You will partner closely...

Sr. Data Engineer Ready to turn bold ideas into real-world impact? At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global...

Career Area:Technology, Digital and DataJob Description:Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We...

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and...

Senior Data Engineer Full-time 7+ years Data Engineer About BuildingBlocks Regardless of whether accomplishing astounding customer work or aiding assemble our organization from the inside, our different gifted organization shares a solitary mission: to fabricate lovely encounters that decidedly affect individuals’ lives and the organizations we serve. Our...

Key Responsibilities: Data Pipeline Development & Optimization Design, develop, and optimize data pipelines using Azure and Databricks. Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. Optimize Spark, SQL, and Python code for performance and scalability. CI/CD & Environment Management Hands-on work...

Engineer, Data Science KLA is seeking a motivated Engineer, Data Science to join our team. This role is perfect for a professional passionate about analyzing, designing, developing, testing, and deploying software solutions that enable the deployment of AI frameworks in heterogeneous clusters, overcoming existing limitations. Responsibilities Analyze...

Responsibilities Strong Skill in Big Query, GCP Cloud Data Fusion (for ETL/ELT) and PowerBI. Need to have strong skill in Data Pipelines Able to work with Power BI and Power BI Reporting Design and implement the data engineering framework and data pipelines using Databricks and Azure Data Factory. Document the high-level design components of the...

infrastructure meets business needs and is scalable, reliable, and efficient. Key Responsibilities: 1. Team Leadership: Manage, mentor, and guide a team of data engineers, ensuring their professional development and optimizing team performance. Foster a culture of collaboration, accountability, and continuous learning within the team. Lead performance...

About Team GDF (Global Data Foundation) is part of Walmart's AI & Data organization - the team building the foundational data platforms that power AI, analytics, and decision-making across every Walmart banner and geography, from supply chain and merchandising to customer experience and enterprise AI agents. Our newly created platform team is chartered with...