Big Data Engineer

2 days ago


Delhi, India Idyllic Services Full time

Job Title: Big Data Engineer – ScalaLocation:Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience:7–10 Years (Minimum 3+ years in Scala)Notice Period:Immediate to 30 DaysMode of Work: HybridRole OverviewWe are looking for a highly skilledBig Data Engineer (Scala)with strong expertise inScala, Spark, Python, NiFi, and Apache Kafkato join our data engineering team. The ideal candidate will have a proven track record inbuilding, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.Key Responsibilities- Design, develop, and optimize large-scaledata pipelinesand distributed data processing systems.- Work extensively withScala, Spark (PySpark), and Pythonfor data processing and transformation.- Develop and integratestreaming solutionsusingApache Kafkaand orchestration tools likeNiFi / Airflow .- Write efficient queries and perform data analysis usingJupyter NotebooksandSQL .- Collaborate with cross-functional teams to design scalablecloud-based data architectures .- Ensure delivery of high-quality code throughcode reviews, performance tuning, and best practices .- Build monitoring and alerting systems leveragingSplunk or equivalent tools .- Participate inCI/CD workflowsusing Git, Jenkins, and other DevOps tools.- Contribute to product development with a focus on scalability, maintainability, and performance.Mandatory Skills- Scala– Minimum 3+ years of hands-on experience.- Strong expertise inSpark (PySpark)andPython .- Hands-on experience withApache Kafka .- Knowledge ofNiFi / Airflowfor orchestration.- Strong experience inDistributed Data Systems (5+ years) .- Proficiency inSQLand query optimization.- Good understanding ofCloud Architecture .Preferred Skills- Exposure tomessaging technologieslike Apache Kafka or equivalent.- Experience indesigning intuitive, responsive UIsfor data analytics visualization.- Familiarity withSplunk or other monitoring/alerting solutions .- Hands-on experience withCI/CD tools(Git, Jenkins).- Strong grasp ofsoftware engineering concepts, data modeling, and optimization techniques .


  • Big Data Engineer

    2 weeks ago


    Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerWe are seeking a skilled data expert to fill this challenging role. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced environment.Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and cloud storage services.Work in...

  • Big Data Engineer

    2 weeks ago


    Delhi, Delhi, India Eqaim Technology & Services Full time

    Job Description : Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while...


  • Delhi, Delhi, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000

    Big Data Engineer RoleThe role of a big data engineer is pivotal in designing, developing, and maintaining scalable and secure big data solutions on cloud-based platforms. The ideal candidate will have expertise in cloud architecture, big data technologies, and data engineering best practices.",

  • Big Data Engineer

    2 weeks ago


    Delhi, Delhi, India prudential Manpower Pvt Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Education and Experience :Bachelor's degree in computer science, or similar technical field Minimum 5 years of experience in Big Data Engineering/Data Analysis5 Days Work From Office :Preferred Skills and Qualifications : Proficiency in Python, SQL and Apache SparkAWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...


  • Kolkata, Delhi, Mumbai, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 30,00,000

    We are currently seeking a highly skilled Data Engineer to lead our data platform development team and drive the creation of robust, scalable data processing solutions.Job Description:Data Engineering Development:Design, develop, and test complex data processing applications using Apache Spark to handle large-scale datasets from various sources, including...


  • Delhi, India Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance.With a focus on innovation and acceleration, Veltris...


  • Delhi, Delhi, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer OpportunityWe are seeking an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing scalable data pipelines, processing systems, and workflows.About the RoleThe ideal candidate will have hands-on experience with big data technologies such as...

  • Big Data Engineer

    4 days ago


    Delhi NCR, Delhi, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000

    We are seeking a proactive Big Data Engineer to design, implement and optimize data processing pipelines on the Databricks platform. As a key member of our team, you will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions and ensuring the reliability and performance of our data...


  • Delhi, Delhi, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title:AWS Data EngineerDescription:We are seeking an experienced AWS Data Engineer to design, develop and maintain big data solutions on AWS.The ideal candidate will have a deep understanding of big data technologies, cloud architecture, and best practices in data engineering.Responsibilities:Design, develop and maintain big data solutions using AWS...