Specialist Software Engineer-Big Data

4 weeks ago

Bengaluru, India Société Générale Assurances Full time

Specialist Software Engineer-Big Data

IT (Information Technology) Permanent contract Bangalore, India Hybrid Reference FC Start date Immediately Publication date 2025/07/25

Responsibilities

Responsibilities

Analyze, organize and process raw data using Bigdata technologies and Scala Perform data validation, cleaning and transformation using Big data technologies, Spark and Scala Ingest and manage data in HDFS/Hive and analyze data using Spark and produce meaningful insights for the business team Combine raw information from different sources, Explore ways to enhance data quality and reliability Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles Help business operations team with data samples to create proof of concepts Ensure the new data sets are feeding the Business Intelligence setup Dashboards on PowerBI Liaise with BA to ensure subjects are getting prioritized, Communicate to PO about progress and potential issues

Profile required

Profile

4 to 5 years of expertise and hands on experience in Spark with Scala and Big data technologies Good working experience in Scala and object oriented concepts Good working experience in HDFS, Spark, Hive and Oozie Technical expertise with data models, data mining, and partitioning techniques Hands-on experience with SQL database Have good understand on CI/CD tools (Maven, Git, Jenkins) and SONAR Good to have knowledge on Kafka and ELK stack. Knowledge on Data visualization tool like PowerBI will be an added advantage. Strong communication and coordination skills with multiple stake holders. Assess existing situation, propose and follow up improvement’s actions Good team spirit, ability to work in international/intercultural environments (lots of interactions with onsite stake holders) Professional attitude: Self-motivated, fast learner, team player, independent

Why join us

"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status"

  • Specialist Software Engineer-Big Data

    4 weeks ago

    Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer-Big Data IT (Information Technology) Permanent contract Bangalore, India Hybrid Reference FC Start date Immediately Publication date 2025/07/25 Responsibilities Responsibilities Analyze, organize and process raw data using Bigdata technologies and Scala Perform data validation, cleaning and transformation using Big...

  • Big Basket

    2 weeks ago

    Bengaluru, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...

  • Specialist Software Engineer

    4 weeks ago

    Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer - Java / Big-data IT (Information Technology) Permanent contract Bangalore, India Reference B1 Start date 2025/07/02 Publication date 2025/06/09 Responsibilities Responsibilities Design, development and testing of components / modules in TOP (Trade Open Platform) involving Spark, Java, Hive and related big-data...

  • Data Architect

    2 weeks ago

    Bengaluru, India TekIT Software Solutions Pvt. Ltd. Full time

    Key Responsibilities :- Design and architect scalable, high-performance Big Data solutions and data platforms on AWS.- Translate business requirements into high-level architectural blueprints ensuring feasibility, functionality, and maintainability.- Develop and optimize data pipelines, ETL processes, and data integration workflows using AWS services (e.g.,...

  • Big Basket

    2 weeks ago

    Bengaluru, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Apple Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    7 days ago

    Bengaluru, India Acme Services Full time

    Job Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...

  • Big Data Engineer

    13 hours ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...