Big Data Engineer

2 days ago

Chennai Tamil Nadu, India CIEL HR Full time

Job Responsibilities Responsible for administering big data systems like EMR HDFS YARN Spark Hive Oozie and others Work closely with development teams at the design phase of big data jobs and pipelines to improve operational efficiency Troubleshoot big data systems for capacity bottlenecks of memory CPU OS storage and network Performance tuning of Hadoop clusters Jobs workflows and pipelines Work with other operations teams to improve big data infrastructure to guarantee high availability Work with AWS support on need basis Fast learner able to pick up new ideas and approaches quickly Will be on-call rotation along with other team members for critical incidents Job Qualification Bachelor s or master s degree in computer science or equivalent 5 years of experience working on big data platforms and related technologies like EMR Hadoop Spark Cassandra etc Hands on experience on AWS cloud certification on AWS cloud is preferred Experience in using Terraform Ansible and scripting language like python and shell Strong understanding of distributed data processing concepts like data partitioning bucketing distributed joins and aggregation Map Reduce etc Strong understanding of Hadoop internals and Linux operating system Should be able to support 24X7 support for critical system Good understanding of programming languages like Java Python etc Good communication skills knowledge of English

  • Big Data Engineer

    6 days ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Tester

    1 week ago

    Chennai, Tamil Nadu, India Warrior tech solutions Full time

    Hi, Greetings from eWarriors Tech Solutions. **Role: Big Data Tester** **Location: Chennai/Bangalore (Onsite)** *** **Experience: 4+ years** **Skills and Qualifications**: - Hands-on experience with Big Data tools (e.g., Hadoop, Spark, Hive). - Proficient in SQL for data validation and querying. - Familiarity with scripting languages (e.g., Python,...

  • Big Data

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role: Big data EngineerExperience: 6 to 8 YearsLocation: Chennai/Mumbai/Pune Skills:Big DataPysparkHiveLocationChennaiJob FunctionTECHNOLOGYRoleDeveloperJob Id373773Desired SkillsDigital : PySpark | Big Data | HiveDesired Candidate ProfileQualifications : BACHELOR OF ENGINEERING, BACHELOR OF TECHNOLOGY

  • Big Data Engineer

    6 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TCS!We are hiring for Bigdata DeveloperJob location: Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, GurgaonDesired experience: 5 to 10 yearsRequired Technical Skill Set: HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, AutosysMust-Have:Hands-on experience in Big data, HadoopHands-on experience in Hive,...

  • Senior Data Engineer

    2 weeks ago

    tamil nadu, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Big Data Lead Engineer

    16 hours ago

    Chennai, Tamil Nadu, India Synechron Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Big Data Lead Engineer - Hadoop - Spark & GCP (BigQuery/DataProc) with Java & Python ExpertiseJob SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutionsThis full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • Big Data Engineer

    5 days ago

    Chennai, India Saaki Argus & Averil Consulting Full time

    Hiring for Big Data: LOCATION: Chennai, Bengaluru, Hyderabad. EXPERIENCE: 7-10 Notice Period : Immediate Joiner or 30 Day Key Skills Hands-on experience on technologies like Python, SQL, Snowflake, HDFS , Hive, Scala, Spark, AWS, HBase and Cassandra. Good knowledge in Data Warehousing concepts. Proficient in Hadoop distributions such as Cloudera,...

  • Big Data

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES! WALK-IN-DRIVE "Big Data" Interview Date: 8th November 2025 Years of Experience: 5 - 10 years Location: Chennai Job Description:- Hands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks distribution Hands on experience on clusters migration /Azure Cloud Upgrading...

  • Big Data

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES! WALK-IN-DRIVE "Big Data" Interview Date: 8th November 2025 Years of Experience: 5 - 10 years Location: Chennai Job Description:- Hands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks distribution Hands on experience on clusters migration /Azure Cloud Upgrading...