Senior Big Data Hadoop Engineer

1 week ago

Chennai, India Anicalls (Pty) Ltd Full time
Candidate should be able to:
Work closely with our QA Team to ensure data integrity and overall system quality
Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements
Write Shell/Python scripts for jobs scheduling and data wrangling
Write Scoop Jobs to Import/Export data from Hadoop
Enhance existing Spark and Java applications, and provide support
Generate data reports using HiveQL, Spark SQL or PySpark
Develop greenfield data applications using Spark, Java, Python, JDBS/ODBC, and other Hadoop/BigData technologies
Design and develop Cloudera HDFS-based solutions using Spark (with interfaces Java, Python, and Spark SQL), Hive QL, Flume, Talend, IBM MQ, and Kafka
Candidate should have:
Ability to identify problems, and effectively communicate solutions to peers and management
Strong debugging skills to troubleshoot production issues
Experience in working with real-time data feeds
Understanding of Data architecture, replication, and administration
Familiarity with Linux OS
Exposure to RDBMS: Microsoft SQL Server, Oracle, DB2
Comfortability working in a team environment
AWS Cloud Analytics experience
Must have 5+ years of experience in using Hadoop/BigData technologies like Spark, Spark SQL, Hive, Flume, Parquet, and Avro file formats, Sqoop, etc.
Must have 5+ years of experience in developing applications using Java, Junit, Maven, and its eco-system
Must have 2+ years of experience in developing Shell/Python scripts
BS/BA degree in Computer Science, Information Systems or related field

  • Big Data Engineer

    2 weeks ago

    Chennai, India Unison consulting pte ltd Full time

    Responsibilities :- Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.- Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.- Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and...

  • Senior Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India MOURI Tech Foundation Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key ResponsibilitiesDevelop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.Implement ETL/ELT workflows and ensure data...

  • Big data developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big data developer

    4 days ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Lead Engineer — Hadoop, Spark

    5 days ago

    Chennai, Tamil Nadu, India Synechron Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions. This full-time leadership role involves guiding a team of data engineers and architects to deliver scalable, efficient, and innovative big data initiatives aligned with organizational and business objectives....

  • Big Data Developer

    3 weeks ago

    Chennai, India IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python) Experience: 5+ Years Locations: Chennai, Bangalore, Gurugram Employment Type: Full-Time Notice Period: Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions....

  • Big data developer

    3 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics...

  • Capco - Hadoop Administrator

    4 weeks ago

    Chennai, India Capco Technologies Pvt Ltd Full time

    Hadoop AdminLocation : Bangalore, Chennai, PuneExperience : 5- 12 YearsEmployment Type : Full-timeWork Mode: Hybrid (during IND hours)Job Overview :We are seeking an experienced Hadoop Admin with 5-12 years of experience to join our PRE-Big Data team. This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of...

  • Big Data Lead Engineer — Hadoop, Spark

    4 days ago

    Greater Chennai Area, India Synechron Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions. This full-time leadership role involves guiding a team of data engineers and architects to deliver scalable, efficient, and innovative big data initiatives aligned with organizational and business objectives....

  • Big Data Developer

    3 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The...