Data Engineer – Python, Airflow, Spark

3 days ago

Pune, Maharashtra, India Bridgenext Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job ID:
Dat-ETP-Pun-1168

Location:
Pune,Bangalore,Other

Company Overview
Bridgnext is a Global consulting company that provides technology-empowered business solutions for world-class organizations. Our Global Workforce of over 800 consultants provide best in class services to our clients to realize their digital transformation journey. Our clients span the emerging, mid-market and enterprise space. With multiple offices worldwide, we are uniquely positioned to deliver digital solutions to our clients leveraging Microsoft, Java and Open Source with a focus on Mobility, Cloud, Data Engineering and Intelligent Automation. Emtec's singular mission is to create "Clients for Life" – long-term relationships that deliver rapid, meaningful, and lasting business value.

At Bridgnext, we have a unique blend of Corporate and Entrepreneurial cultures. This is where you would have an opportunity to drive business value for clients while you innovate and continue to grow and have fun while doing it. You would work with team members who are vibrant, smart and passionate and they bring their passion to all that they do – whether it's learning, giving back to our communities or always going the extra mile for our client.

Position Description
We are looking for members with hands-on Data Engineering experience who will work on the internal and customer-based projects for Bridgnext. We are looking for someone who cares about the quality of code and who is passionate about providing the best solution to meet the client needs and anticipate their future needs based on an understanding of the market. Someone who worked on Hadoop projects including processing and data representation using various AWS Services.

Must Have Skills

  • 3-5years of overall experience
  • Strong programming experience with Python, Spark
  • Experience with unit testing, debugging, and performance tuning.
  • Experience with cloud platforms (AWS preferred)
  • Experience with CI/CD Gitlab pipelines
  • Familiarity with workflow management tools like Airflow.
  • Experience with Docker, Kubernetes, and DBT is a plus.
  • Good to have experience with infrastructure-as-a-code technologies such as Terraform, Ansible
  • Good to have experience in Snowflake modelling – roles, schema, databases.

Professional Skills

  • Solid written, verbal, and presentation communication skills
  • Strong team and individual player
  • Maintains composure during all types of situations and is collaborative by nature
  • High standards of professionalism, consistently producing high-quality results
  • Self-sufficient, independent requiring very little supervision or intervention
  • Demonstrate flexibility and openness to bring creative solutions to address issues

  • Senior Spark Developer

    2 weeks ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark Rockstar Wanted Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data...

  • Python and Spark developer

    1 week ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Duration of contract*12 monthsTotal Yrs. of Experience*3+Relevant Yrs. of experience*3+Detailed JD *(Roles and Responsibilities)Develop and maintain legacy application and new platform(Roleswap, Migration, Patching, Mandatory upgrades)Mandatory skills*Python,Spark,Spark SQL,GIT,PostgreSQL,Airflow,Jenkins,KubernetesDesired skills*Camunda knowledge of Camunda...

  • Sr. Spark Big Data Developer

    3 days ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Sr. Spark Big Data DeveloperPFB the detailed JD:�� Experience: 5 to 7+ years (Hands-on)�� Notice Period: 0-30 DaysMust Have: Proficiency in at least one of the following programming languages:Java/Scala/Python Good understanding of SQL Experience of development and deployment of at least one end-to-end datastorage/processing pipeline...

  • Python + Airflow Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Designation: Python + airflow DeveloperExperience: 5+ YearsRemote OpportunityImmediate JoinersJD:Python Developer with strong experience into Airflow DevelopementSincerely,Sonia TS

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Binary Star SearchX Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Description : - Minimum 5 years of experience in data analytics field - Experience with Azure/AWS Databricks - Experience in building and optimizing data pipelines, architectures and data sets - Excellent experience in Scala or Python, PySpark and SQL - Ability to troubleshoot and optimize complex queries on the Spark platform -...

  • Senior Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience: 5+ yearsLocation: Pune, India (Work from Office)Must Have:Spark development with batch and streaming experienceExperience with Pyspark and Data EngineeringETL implementation and migration to sparkProgramming knowledge on scala, java & pythonExperience with Kafka and Spark streaming (Dstream and Structured Streaming)Experience with using Jupyter...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Go Digital Technology Consulting LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: Python Data EngineerLocation:Pune / RemoteExperience Level:3–8 yearsRole OverviewWe are looking for a Python-centric Data Engineer who can design and maintain scalable, high-performance data pipelines for large and complex datasets. The ideal candidate brings strong object-oriented Python programming skills, experience with distributed data...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India micro1 Full time ₹ 12,00,000 - ₹ 2,50,00,000 per year

    Position: Senior Data EngineerLocation: Delhi , Pune (Hybrid)Experience: 3–8 YearsJoining: Immediate to 30 DaysJob type : Contract (Full time)Role OverviewLooking for a skilled Data Engineer with strong expertise in SQL, Python, and PySpark to design and build scalable data pipelines and solutions. You'll work with cross-functional teams to ensure...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Exciting Job Opportunity in Pune Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for youKey Requirements : - Minimum of 5+ years of experience - Proficient in Spark development for batch and streaming applications - Skilled in Pyspark and Data Engineering - Expert in ETL...

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Purview Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior DE:Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering.Job responsibilitiesSoftware design, Scala and Python - Spark development...