Big Data Developer

2 days ago

New Delhi, India IntraEdge Full time

Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experiencedBig Data Engineerwith strong expertise inPythonto design, build, and manage large-scale data pipelines and analytics solutions. The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing efficient, scalable, and maintainable code. Key Responsibilities Design, develop, and maintain scalable big data pipelines using Python and other data processing tools. Work with distributed data processing frameworks like Spark, Hadoop, Hive, or similar. Implement ETL processes for structured and unstructured data from various sources. Collaborate with data scientists, analysts, and other engineering teams to understand data needs. Optimize data workflows and ensure data quality, integrity, and security. Deploy solutions on cloud platforms (AWS/GCP/Azure) and automate data workflows. Monitor data pipelines, troubleshoot issues, and ensure high availability and performance. Required Skills & Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. Minimum 5 years of hands-on experience in Big Data engineering roles. Strong proficiency inPythonfor data processing and scripting. Experience withApache Spark , Hadoop ecosystem (Hive, HDFS, HBase), Kafka. Solid understanding of data warehousing concepts and data modeling. Hands-on experience withSQLand NoSQL databases. Familiarity with cloud data platforms likeAWS (EMR, S3, Glue) ,Azure , orGoogle Cloud . Good understanding of CI/CD, containerization (Docker, Kubernetes), and version control (Git). Preferred Skills (Nice to Have) Experience with Airflow or other workflow orchestration tools. Knowledge of real-time data processing (e.g., Spark Streaming, Flink). Exposure to data governance, data lineage, and catalog tools. Why Join Us? Opportunity to work on cutting-edge Big Data solutions with global clients. Collaborative and innovation-driven work culture. Competitive compensation and career growth opportunities. Flexible work environment with hybrid (based on role).

  • Big Data Developer

    2 days ago

    New Delhi, India UST Full time

    We are seeking aBig Data Engineerwith strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization.Key Responsibilities: Design, develop, and optimize big...

  • Big Data Developer

    2 days ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ ChennaiJob Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    2 weeks ago

    Delhi, India UST Full time

    We are seeking aBig Data Engineerwith strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization.Key Responsibilities:Design, develop, and optimize big...

  • Big Data Developer

    2 weeks ago

    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    2 weeks ago

    Delhi, India Hireologist Full time

    Job Title:Big Data EngineerLocation:Pune (Hybrid)Experience- 5-7 YOESalary Range:₹35–40 LPAAbout the RoleWe are looking for aBig Data Engineerto design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical strategies...

  • Big Data Engineer

    2 days ago

    New Delhi, India Rapinno Tech Solutions Pvt.Ltd. Full time

    Big Data EngineerLocations: Hyderabad | Chennai | Pune | BangaloreSkills: Scala, Python, Apache Spark, PySpark, AWS, CI/CDExperience: 3 to 11 yearsScala DeveloperMultiple LocationsStrong hands-on experience in Scala & distributed data processing

  • Big Data Engineer

    2 days ago

    New Delhi, India Sky Systems, Inc. (SkySys) Full time

    Role: Big Data EngineerPosition Type: Full-Time Contract (40hrs/week)Contract Duration: Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data...

  • Architect : Big Data

    5 days ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Big Data Tester

    3 weeks ago

    Delhi, Bengaluru, Pune, India Impetus Technologies Full time

    Job Description - Good knowledge of Big Data components and ETL. - Thorough understanding of SDLC & STLC. - Good experience in writing and executing functional/non-functional end-to-end test cases. - Good hands-on knowledge of any database. - Good hands-on experience in end-to-end debugging of a solution. - Good hands-on experience in Linux OS w.r.t...

  • (23/09/2025) Big Data Developer

    2 weeks ago

    Delhi, India KPG99 INC Full time

    About the Role: Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian’s global data ecosystem. You will be instrumental in building scalable data pipelines, integrating...