big data engineer data analysis jobs in Chennai

Job Summary A Data Analyst interprets data and helps turn it into information that enables or improves a business process, thus affecting business decisions. Data Analysts gather information from various sources and interpret patterns and trends to make it digestible for others. They must have strong analytical skills, but above all have a burning curiosity...

Role: Big Data Developer Experience: 6-10 yrs location: chennai, pune, bengalore Responsibility: • Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting • Should be comfortable with Unix File system as well as HDFS commands • Should have worked on query languages such...

Role: Big Data & Hadoop Ecosystem Developer (MapR) Experience: 5–12 Years Location: Mumbai, Chennai, Hyderabad, Bangalore, Indore Ahmedabad Job Type: Full-Time Job Summary • Design, develop, and maintain big data solutions using the Hadoop ecosystem and MapR platform. • Build scalable ETL/ELT pipelines for structured, semi-structured, and unstructured...

Big data developer/Lead Key Responsibilities: • Data Pipeline Development: Designing, developing, and maintaining data pipelines to efficiently move and transform large datasets from various sources. • System Design and Architecture: Creating the overall architecture of the big data platform and ensuring its scalability, performance, and reliability. •...

BigData Developer Key responsibilities (please specify if the position is an individual one or part of a team): The role requires a hands-on technologist with expertise in Data Engineering with strong programming background in Hadoop/Hive/Sparks/Scala Should have hands-on knowledge on GCP cloud platforms. Role & Responsibilities: 1. Provide technical...

We are looking for someone with advanced Python programming skills who applies robust software engineering principles to data problems. You will collaborate closely with Data Scientists, ML Engineers, and Product Managers to build the scalable, automated pipelines required to train, deploy, and monitor machine learning models in...

We are seeking an experienced Data Engineer with 5+ years of hands-on expertise across the modern data stack to design, build, and maintain high-performance ELT pipelines. In this role, you will be the core technical owner of our analytics foundation—leveraging Snowflake, dbt, hosted on cloud infrastructure (AWS, Azure, or GCP). You will partner closely...

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Career Area:Technology, Digital and DataJob Description:Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We...

Job SummarySynechron is seeking a Data Engineer with strong expertise in PySpark and the Cloudera Data Platform (CDP) to design, develop, and maintain scalable data pipelines.The role is responsible for building reliable data ingestion and transformation processes, working with large-scale datasets, and supporting distributed data-processing environments....

Sr. Data Engineer Ready to turn bold ideas into real-world impact? At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global...

About us: One team. Global challenges. Infinite opportunities. At Viasat, we’re on a mission to deliver connections with the capacity to change the world. For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries around the globe communicate. We’re looking for people who think big, act fearlessly, and create...

Should be able to design (high level / low level) software solutions for the new requirements. Coding independently and with other team members with proper software industry standard best practices. Collaborate with data analysts/ product managers in understanding the data. - Work closely with Data Analysts and QA (Quality Assurance) teams and deliver the...

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

About the Role As a Senior Data Engineer , you will become part of a cross-functional development team focused on engineering the data experiences of tomorrow. This role is ideal for someone passionate about scalable data systems, eager to solve complex problems, and ready to work in a dynamic environment. Responsibilities Build and prototype scalable data...

About the Role As an Expert Data Engineer , you will be part of a cross-functional development team dedicated to building innovative, scalable data solutions that drive tomorrow's experiences. You will design and maintain large-scale data infrastructure, work closely with analysts and data scientists, and contribute to internal technical communities....

Qualification 3-5 Years of overall IT experience as a Data Engineer with hands on expertise in building data pipeline, data transformation and metadata creation involving large complex and disconnected data sets. Graduate in Computer Science, Statistics, Informatics, Information Systems or another quantitative field Data Engineering Certification from GCP. ...

Analyse existing software solutions for training and deployment and identify limitations. Design, develop, test, and deploy software solutions that address the above limitations and enable deployment in a heterogeneous cluster. Collaborate with a global team in developing such solutions. Minimum Qualifications Bachelor's degree in engineering with 2-5...

About This Role Bounteous x Accolite is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today's complex challenges and tomorrow's opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy,...