Big Data Engineer

3 days ago

Bengaluru, Karnataka, India Saransh Software Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title: Data Engineer

Experience: 8+ years

Location: Bengaluru

Notice Period: Immediate to 20 Days

Employment Type: Full-time

About the RoleWe are looking for an experienced Data Engineer with strong expertise in Python, Spark, and PySpark to design, develop, and optimize large-scale data pipelines and distributed systems. The ideal candidate will possess a deep understanding of Big Data platforms, data modeling, and data quality frameworks, and will work collaboratively within a fast-paced, agile environment to deliver reliable and high-performing data solutions.

Experience Requirements

  • 5+ years of professional experience in Data Engineering, Data Pipeline Development, or Big Data Platform Development
  • Proven experience in data architecture, data modeling, and ETL design

Technical Skills & ExpertiseBig Data & Distributed Systems

  • Hands-on experience with Hadoop, Spark, MapReduce, Hive, HBase, and other distributed computing frameworks
  • Proficiency in PySpark for scalable data transformations and analytics

Programming & Software Engineering

  • Strong development skills in Python (best practices: linting, unit testing, integration testing, code review, Git flow)
  • Knowledge of algorithms, data structures, and data validation techniques
  • Experience with bash scripting and Linux OS configuration

Data Architecture & Databases

  • Expertise in data warehousing, data modeling (Relational, ETL, OLTP)
  • Strong SQL skills (SQL, PL/SQL, T-SQL); exposure to NoSQL databases is a plus
  • Experience with data quality assessment, including profiling, anomaly detection, and schema documentation

DevOps & Agile Practices

  • Familiarity with CI/CD pipelines and tools like GitHub, Jenkins, and Docker
  • Understanding of Agile methodology, DevOps principles, and modern software delivery practices
  • Troubleshooting distributed systems and production issues in a collaborative environment

Functional Skills

  • Proven experience working in Agile teams
  • Ability to ensure technical quality, scalable design, and maintainability of data systems
  • Strong analytical and problem-solving skills; capable of benchmarking and evaluating emerging technologies
  • Prior experience in Banking, Financial Services, or FinTech domains is highly preferred
  • Capable of influencing cross-functional teams and improving technical productivity through mentorship and collaboration

If you have the skills and are ready to make an impact, we'd love to hear from you Apply today or share this post with someone who might be interested.

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Big Data Engineer Tech Stack: Python, Hive & Apache Spark Java & Advanced SQL Hadoop & Big Data Ecosystem Apache Airflow & ETL Pipelines Docker & Containerization Data Modelling & Warehousing Experience- 5 years Share your updated resume now.

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineers/Senior Engineers

    1 week ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...