Big Data Software Engineer

1 week ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000
Job Description

As a data engineer in our team, you will play a pivotal role in shaping our technology and product roadmap. We are seeking a highly skilled professional to design, develop, solve problems, debug, evaluate, modify, deploy, and document software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.

Our ideal candidate will have hands-on expertise with application design, software development, and automated testing. A strong programming knowledge in SQL, PySpark, Data Proc, Big Query is essential, along with hands-on experience in Big Data technologies (Spark, Hive). Understanding and experience with UNIX / Shell / Perl / Python scripting, Database query optimization and indexing, Web services design and implementation using REST / SOAP and Java are also a plus.

The successful candidate will be able to collaborate with the business to drive requirements/Agile story analysis, and have experience designing and coding across one or more platforms and languages as appropriate. Bonus skills include Machine learning/data mining, Object-oriented design and coding, and Adobe Marketing Campaign products.

Roles & Responsibilities
  • Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.
  • Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.
  • Proficient in Big Query to carry out batch and interactive data analysis.
  • Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation).
  • Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality.
  • Enable the deployment, support, and monitoring of software across test, integration, and production environments.

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India IT Firm Full time

    Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Basket

    3 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their resume with the following details to Current CTC Expected CTC Location

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Location – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Role OverviewWe are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Cloud Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000

    Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.