Big Data Developer

1 week ago

Bengaluru, Karnataka, India SP Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year
  • Preferred candidate profile - Currently serving Notice Period who can join with in days only
  • 5+ Years of Experience is Mandate in AWS and Bigdata

Role & responsibilities

  • Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)

    • Write SQL queries to validate the dashboard output

    • Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.

    • Performing code reviews and pair programming

    • Supporting and enhancing current applications

    • Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.
  • Profound understanding of Big Data core concepts and technologies Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

    • Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

    • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

    • Programming experience with Python/Scala, Shell scripting.

    • Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.

    • Good understanding of business and operational processes.

    • Capable of Problem / issue resolution, capable of thinking out of the box.

Preferred candidate profile

AWS, Big Data Engineer, Data Engineer (Bigdata, Redshift, spark, Scala and AWS)

5+ Years of Experience is Mandate in AWS and Bigdata

6+ years experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

• 6+ years experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

• 6+ years experience with Spark programming paradigms (batch and stream-processing)

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob Description- Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.- Strong SQL experience.- Should be able to develop, tweak queries and work on performance enhancement.- Solid...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Grid Dynamics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    7 to 15 Years of experience in Big Data Developer (Mandatory Splunk to ClickHouse and Grafana)Essential FunctionsKey Responsibilities7 to 15 Years of experience in Big Data DeveloperDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to ClickHouse and Grafana.Implement data ingestion, transformation, and validation...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data Developer Experience: 4 to 10 Years Notice Period- 0-60 Days Location-Bengaluru Required Skill Set_ Hadoop, PySpark, Spark SQL, HIVE Job Description Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. Strong SQL experience. Should be able to develop, tweak queries and work on performance enhancement....

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Big Data DeveloperExperience: 4 to 10 YearsNotice Period- 0-60 DaysLocation-BengaluruRequired Skill Set_ Hadoop, PySpark, Spark SQL, HIVEJob DescriptionHands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools.Strong SQL experience.Should be able to develop, tweak queries and work on performance enhancement.Solid understanding...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India ARA Resources Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About The Company : ARAs client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain, and process expertise. They have also been ranked 29 of 100 largest financial technology vendors by American Banker and BAI in the FinTech...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Required Skills:Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python.Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS.Ability to handle data integration, bug fixing, performance optimization, and feature enhancements for distributed data pipelines.Having experience with...

  • Senior Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description Key Responsibilities Design and develop scalable and efficient big data solutions to process and analyze large datasets. Build and optimize ETL/ELT pipelines for data ingestion, transformation, and storage.Work with Apache Spark, Hadoop, Kafka, and other big data frameworks to develop high-performance data processing solutions. Implement and...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Cerebra Consulting Inc Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Title: Big Data DeveloperT Exp: 5+yearsR Exp: 4+yearsNp: Immediate joiners or 15daysPayroll: Cerebra IT Services Pvt Ltd.,Work Mode: Work From Office(WFO)JD:Spark, Scale, Python, Hive/SQL, Kafka with Banking Project.

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before interview. To create an EP...