Big Data Developer

5 days ago

Bengaluru, Karnataka, India SP Software Full time US$ 90,000 - US$ 1,20,000 per year
  • Preferred candidate profile - Currently serving Notice Period who can join with in days only
  • 5+ Years of Experience is Mandate in AWS and Bigdata

Role & responsibilities

  • Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)

    • Write SQL queries to validate the dashboard output

    • Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.

    • Performing code reviews and pair programming

    • Supporting and enhancing current applications

    • Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.
  • Profound understanding of Big Data core concepts and technologies Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

    • Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

    • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

    • Programming experience with Python/Scala, Shell scripting.

    • Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.

    • Good understanding of business and operational processes.

    • Capable of Problem / issue resolution, capable of thinking out of the box.

Preferred candidate profile

AWS, Big Data Engineer, Data Engineer (Bigdata, Redshift, spark, Scala and AWS)

5+ Years of Experience is Mandate in AWS and Bigdata

6+ years experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

• 6+ years experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

• 6+ years experience with Spark programming paradigms (batch and stream-processing)

  • Big Data Developer

    14 hours ago

    Bengaluru, Karnataka, India Tech Consulting Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    The primary objective of this role is to design and develop data pipelines utilizing Big Data technologies. A deep understanding of Py Spark, Hive, and Spark optimization is crucial for success in this position.Key Responsibilities Develop and maintain data pipelines using Big Data technologies. Collaborate with cross-functional teams to identify and...

  • Big Data Developer

    5 days ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Role Overview: Spark/Scala Developer (Big Data) We are seeking experienced Big Data Engineers with strong expertise in Scala and Apache Spark to join our team. The ideal candidate will be responsible for designing and implementing scalable data solutions, optimizing performance, and translating business requirements into technical deliverables. Key...

  • Big Basket

    6 days ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    As a Big Data Developer, you will work closely with cross-functional teams to design and implement scalable data pipelines using Databricks and Hadoop.Key Responsibilities :Create robust and efficient data architectures to support real-time analytics and data-driven decision making.Leverage big data processing and cloud-based analytics tools like Databricks...

  • Big Basket

    6 days ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Senior Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India beBeeBigDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data EngineerWe are seeking a skilled and innovative Big Data Engineer to join our team. This role involves designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data.Key Responsibilities:Data Pipeline Development: Design, build, and maintain robust and scalable ETL...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have strong experience in Scala, Spark, and Big Data ecosystem.Key ResponsibilitiesDesign and develop scalable data engineering solutions using Scala & SparkImplement unit testing best practices to ensure code qualityRequirementsHands-on experience with...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Maimsd Technology Full time

    Job DescriptionBig Data Developer - Spark/HadoopWe are seeking an experienced Big Data Developer with expertise in Hadoop, Spark, and Kafka to take complete ownership of the software development lifecycle, from requirement gathering to final deployment. This role is ideal for a proactive individual who can translate business use cases into robust, scalable,...