Specialist Software Engineer-Big Data

7 days ago


Bengaluru, India Société Générale Assurances Full time

Specialist Software Engineer-Big Data

IT (Information Technology) Permanent contract Bangalore, India Hybrid Reference FC Start date Immediately Publication date 2025/07/25

Responsibilities

Responsibilities

Analyze, organize and process raw data using Bigdata technologies and Scala Perform data validation, cleaning and transformation using Big data technologies, Spark and Scala Ingest and manage data in HDFS/Hive and analyze data using Spark and produce meaningful insights for the business team Combine raw information from different sources, Explore ways to enhance data quality and reliability Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles Help business operations team with data samples to create proof of concepts Ensure the new data sets are feeding the Business Intelligence setup Dashboards on PowerBI Liaise with BA to ensure subjects are getting prioritized, Communicate to PO about progress and potential issues

Profile required

Profile

4 to 5 years of expertise and hands on experience in Spark with Scala and Big data technologies Good working experience in Scala and object oriented concepts Good working experience in HDFS, Spark, Hive and Oozie Technical expertise with data models, data mining, and partitioning techniques Hands-on experience with SQL database Have good understand on CI/CD tools (Maven, Git, Jenkins) and SONAR Good to have knowledge on Kafka and ELK stack. Knowledge on Data visualization tool like PowerBI will be an added advantage. Strong communication and coordination skills with multiple stake holders. Assess existing situation, propose and follow up improvement’s actions Good team spirit, ability to work in international/intercultural environments (lots of interactions with onsite stake holders) Professional attitude: Self-motivated, fast learner, team player, independent

Why join us

"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status"



  • Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer-Big Data IT (Information Technology) Permanent contract Bangalore, India Hybrid Reference FC Start date Immediately Publication date 2025/07/25 Responsibilities Responsibilities Analyze, organize and process raw data using Bigdata technologies and Scala Perform data validation, cleaning and transformation...


  • Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer - Java / Big-data IT (Information Technology) Permanent contract Bangalore, India Reference B1 Start date 2025/07/02 Publication date 2025/06/09 Responsibilities Responsibilities Design, development and testing of components / modules in TOP (Trade Open Platform) involving Spark, Java, Hive and related big-data...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, India Suzva Software Technologies Full time

    Hiring: Big Data Engineer (PySpark)Client: (Details will be shared upon shortlisting)Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETL Interested candidates can share their...

  • Big Data Engineer

    12 hours ago


    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...


  • Bengaluru, India Talpro Full time

    About the Role :We are seeking a Senior Software Engineer Big Data Platform Engineer to design, develop, and optimize large-scale data processing systems.You will work with high-volume, high-velocity datasets and ensure the platforms scalability, performance, and reliability.This role requires expertise in big data frameworks, distributed systems, and data...

  • Big Basket

    3 weeks ago


    Bengaluru, India Big Basket Full time

    What would you be doing/ Expected from this role? - Be responsible for Platforms Team roadmap and engineering execution from conceptualization to delivery of current and next-generation tools & technologies.- Manage release planning, execution, deployment of all tools maintained by Platforms Team, for running production and non-production environments...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, India Coders Brain Full time

    Job Description Roles and Responsibilities: - Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation. - Work closely across an array of various teams and organizations in the company (including partners, customers) Basic Qualifications: - Bachelor's...

  • Big Data Developer

    2 weeks ago


    Bengaluru, Karnataka, India SP Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Preferred candidate profile - Currently serving Notice Period who can join with in days only 5+ Years of Experience is Mandate in AWS and BigdataRole & responsibilitiesExperience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)• Write SQL queries to validate the dashboard output• Working experience with database environment -...


  • Bengaluru, Karnataka, India Apple Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the...


  • Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Role:We're hiring 2 Cloud & Data Engineering Specialists to join our fast-paced, agile team. These roles are focused on designing, developing, and scaling modern, cloud-based data engineering solutions using tools like Azure, AWS, GCP, Databricks, Kafka, PySpark, SQL, Snowflake, and ADF.Position 1: Cloud & Data Engineering Specialist Resource 1Key...