Big Data Developer

3 weeks ago

india, IN BayOne Solutions Full time

Job Description:

We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices.


Key Responsibilities:

  • Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms.
  • Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable microservices with Core Java (8+) and Spring Boot.
  • Collaborate on system design, including API development and event-driven architecture.
  • Contribute to front-end development (JavaScript, React) as needed.
  • Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar.
  • Utilize modern CI/CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.


Qualifications:

  • 5+ years of professional experience as a Software/Data Engineer or Full Stack Engineer.
  • Strong programming skills in Scala, Python, and Java.
  • Experience with Databricks, Spark SQL, Spark Streaming, and PySpark.
  • Hands-on experience with Azure cloud services and data engineering tools.
  • Solid knowledge of microservices development with Spring Boot.
  • Familiarity with event-driven platforms such as Kafka.
  • Experience with CI/CD pipelines and containerization/orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).


Nice to Have:

  • Experience with API design and event-driven architecture.
  • Frontend development experience with React and JavaScript.

  • Big Data Engineer

    3 weeks ago

    india, IN Alef Education Full time

    Who we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...

  • Hiring for Java Big Data

    3 weeks ago

    , India, IN Deloitte Full time

    Deloitte India is hiring for Java + Big Data (Big data is mandatory) candidates for Chennai location. Interested candidates can apply.Looking for 6 to 9 Years of experience candidates.Job descriptionRole - Key Responsibilities:Big Data Technologies - Hadoop, Apache Spark, Apache Kafka, Flink (Good to have)Develop and maintain scalable backend services using...

  • Data Engineer

    3 weeks ago

    india, IN Dautom Full time

    Job Description: Data Engineer (Big Data/Kafka) We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.Key Details:Role: Data EngineerIndustry: Banking (Financial Services)Work Location: Remote (India)Contract Duration: 6...

  • Data Engineer

    3 weeks ago

    india, IN Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Data Engineer

    3 weeks ago

    india, IN Insight Global Full time

    Position: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...

  • Data Engineer

    3 weeks ago

    india, IN Idyllic Services Full time

    Experience: 5- 10 YearsNotice Period: 0-30 DaysMandatory Skills: Code Optimization , Shell Scripting, Data Engineering & ScalaPreferred Skills: Big Data tools like Spark, Hadoop & HiveJob Description:The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support...

  • Data Engineer

    3 weeks ago

    india, IN Insight Global Full time

    Job DescriptionInsight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion. You will be assisting the Data and Analytics team on one of the company's largest game titles set to launch this fall. Your day-to-day will be...

  • RE & DevOps Engineer (Big Data & AI Platform) Contract Position | Global E-Commerce Leader | Bangalore

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN Prospance Inc Full time

    About the OpportunityWe're partnering with a leading global e-commerce company to find an exceptional SRE & DevOps Engineer specializing in Big Data technologies. Join their AI Platform Team and power the data infrastructure that drives innovation for millions of users worldwide.In this transformative role, you'll support cutting-edge AI platforms handling...

  • Senior Data Scientist

    3 weeks ago

    india, IN Delivery Hero Full time

    About Delivery Hero India: Delivery Hero India is part of Delivery Hero Group, the world’s leading local delivery platform. We operate in over 70+ countries worldwide, powered by tech but driven by people. Headquartered in Berlin, Germany. Delivery Hero has been listed on the Frankfurt Stock Exchange since 2017 and is part of the MDAX stock market index....

  • Senior Data Modeler

    3 weeks ago

    india, IN Philodesign Technologies Inc Full time

    Position: Senior Data ModelerExperience: 7+ YearsShift: General ShiftLocation: RemoteRole OverviewWe are seeking an experienced Senior Data Modeler to design, develop, and maintain conceptual, logical, and physical data models that support business and analytical requirements. The ideal candidate will translate complex business needs into efficient and...