Big Data Developer

20 hours ago

Delhi, India Impetus Full time
Lead Software Engineer

Locations- Indore, Noida, Hyderabad

Job Description

We are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets.

Roles & Responsibilities

Key Responsibilities

- Architect Data Solutions: Design and implement scalable, high-performance big data architectures using industry-leading tools and technologies.- Lead Development Efforts: Oversee the end-to-end development of big data workflows, pipelines, and applications.- Mentor Team Members: Provide technical guidance, conduct code reviews, and foster a culture of continuous improvement within the team.- Optimize Performance: Identify bottlenecks in data processing workflows and implement strategies for optimization.- Collaborate: Work closely with data scientists, engineers, analysts, and business stakeholders to understand requirements and deliver solutions.- Data Governance: Ensure compliance with data privacy regulations and best practices in data management.- Innovate and Stay Current: Research emerging big data technologies and incorporate them into the organization's tech stack as appropriate.

Required Skills and Qualifications

- Big Data Expertise: Experience working with big data technologies like Apache Spark, Hadoop, Hive, and HBase.- Programming Skills: Advanced proficiency in Python, Scala, or Java, with experience in functional programming.- ETL and Data Pipelines: Extensive experience in building and optimizing ETL pipelines for large-scale data ingestion and transformation.- Data Management: Expertise in handling structured and unstructured data in formats like Parquet, Avro, ORC, JSON, and CSV.- Performance Tuning: Proven ability to optimize distributed computing jobs for resource and cost efficiency.- Database Knowledge: Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).- DevOps Integration: Experience with CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).- Leadership: Demonstrated ability to lead teams, manage projects, and mentor junior developers.

  • Big data developer

    4 days ago

    Delhi, India Luxoft Full time

    Project Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...

  • Big Data Developer

    4 weeks ago

    delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQL Previous experince into big data projects using hadoop and spark. Atleast one project experience into Cloudera hadoop with Impala and Hue Strong Programming experience in Python and PySpark Hands on experience in SQL using Impala Experience in...

  • Big Data Developer

    3 weeks ago

    delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQL Previous experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big Data Developer

    4 weeks ago

    delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big Data Developer

    4 weeks ago

    Delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big data developer

    4 weeks ago

    Delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, Py Spark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and Py SparkHands on experience in SQL using ImpalaExperience in...

  • Big Data

    3 months ago

    delhi, India Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job description Full-Time Big Data (Hadoop) Developer Myananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience : 3 - 5 Years. Salary : 5.0 -...

  • Big Data Developer

    3 months ago

    Delhi, India Grid Dynamics Full time

    Note -Candidate should be an Immediate joiner or within 30 days.This is a Hybrid position in Bangalore (Only Local candidates will be considered for this role or some who can relocate in a day or two)Details required: (Share your resume to with below details for faster response)Total Years of experience -Notice period -CTC -Expected CTC -Current Location...

  • Java big data developer

    7 days ago

    Delhi, India IITMatrix Full time

    Work location : Singapore Mandate skills: Java, microservices, big data, spring bootTEAM Architecture (Big Data)Experience with application development in Big Data Ecosystem (such as Cloudera, Elastic Search, Spark, Presto, Hive, Impala, Kibana, Logstash, Hbase, Kafka),Expertise in building applications using Scala, Java, Python, Shell scripting,...

  • Big Data SME

    1 day ago

    Delhi, India Tech Consulting Full time

    **Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...

  • Big Data Developer

    3 weeks ago

    new delhi, India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQL Previous experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big Data Developer

    1 day ago

    Delhi, India Tata Consultancy Services Full time

    Desired Competencies (Technical/Behavioral Competency)Must-Have •5+ years of active development experience with Java, Scala, Spark, Hive, Kafka, NoSql Databases •Having core fundamentals experience of Apache Hadoop components •Understanding best practices for Big Data (in Hadoop), data processing •Strong experience and debugging skills in Java, Scala...

  • Big Data Engineer

    1 month ago

    Delhi, Delhi, India Talent Pro Full time

    Hadoop Developer Job DescriptionWe are currently looking for a skilled and experienced Hadoop Developer to join our team at Talent Pro.As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale big data processing pipelines using the Hadoop ecosystem (HDFS, MapReduce) and Spark.The ideal candidate will have a strong...

  • Big Data Developer

    3 weeks ago

    Delhi, India Quess IT Staffing Full time

    Experience as a Big Data Developer and experienced in Data Ingestion with strong track record of designing and implementing data solutions.• Experience in programming language as Python or Java, with experience in building data pipelines and workflows.• Experience with cloud data warehousing technologies, such as Snowflake and Redshift.• Experience...

  • Big Data Engineer

    3 weeks ago

    Delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Engineer

    3 weeks ago

    delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big data engineer

    3 weeks ago

    Delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in Py Spark, Python, My SQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...

  • Big Data Engineer

    3 weeks ago

    delhi, India Pert Telecom Solutions Full time

    Job Description:We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for this...

  • Big Data Engineer

    3 weeks ago

    Delhi, India Pert Telecom Solutions Full time

    Job Description:We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for this...

  • Big Data Developer

    4 weeks ago

    delhi, India Impetus Full time

    F2F Hiring Drive on 16th Nov in Pune. Location: Impetus Technologies India Pvt. Ltd 3rd Floor, We Work, Raheja Woods Kalyani Nagar, Pune – 411006 (Maharashtra) Exp: 3.5-6yrs Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriate Hands-on expertise with application design, software...