Lead Software Engineer

24 hours ago

Bengaluru, Karnataka, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

What youll do:

  • We seek Software Engineers with experience building and scaling services in on-premises and cloud environments.
  • As a Principal Software Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.
  • Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows.
  • Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine.
  • Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies SCRUM.

Qualifications

  • Strong experience (5 -8 years) in Scala programming language and extensive experience with Apache Spark for Big Data processing for design, developing and maintaining scalable on-prem and cloud environments, especially on AWS and as needed with GCP cloud.
  • Proficiency in performance tuning of Spark jobs, optimizing resource usage, shuffling, partitioning, and caching for maximum efficiency in Big Data environments.
  • In-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.
  • Expertise in designing and implementing scalable, fault-tolerant data pipelines with end-to-end monitoring and alerting.
  • Using Python to develop infrastructure modules. Hence, hands-on experience with Python.
  • Solid grasp of database systems and SQLs for writing efficient SQLs (RDBMS/Warehouse) to handle TBS of data.
  • Familiarity with design patterns and best practices for efficient data modelling, partitioning strategies, and sharding for distributed systems and experience in building, scheduling and maintaining DAG workflows.
  • End-to-end ownership with definition, development, and documentation of softwares objectives, business requirements, deliverables, and specifications in collaboration with stakeholders.
  • Experience in working on GIT (or equivalent source control) and solid understanding of Unit and integration test frameworks.
  • Must have the ability to collaborate with stakeholders/teams to understand requirements and develop a working solution and the ability to work within tight deadlines and effectively prioritize and execute tasks in a high-pressure environment.
  • Must be able to mentor junior staff.

Advantageous to have experience on below:

  • Hands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues.
  • Proficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualization.
  • Strong background in analytics, including the ability to derive actionable insights from large datasets and support data-driven decision-making.
  • Experience with data visualization tools like Tableau, Power BI, or Grafana.
  • Familiarity with Docker for containerization and Kubernetes for orchestration.

Required Skills Programming Languages, Scala Programming, Apache Spark, Hadoop Ecosystem, SQL Proficiency

Exp.- 9-12yrs

  • Technical Lead Software Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    Guidewire is searching for a who is passionate about Technical Lead role Java all things data from polishing data under the hood to visualizing complex data sets in mind blowing ways You will help architect our next generation of data analytics and visualization tools to help insurance companies glean actionable insights into their operational performance...

  • Software Engineer

    3 weeks ago

    Bengaluru, Karnataka, India MRI Software Full time

    Job Title : Software Engineer - .Net & ReactReports to : VP Product ManagementLocation : BangaloreMRI Software is seeking a Software Engineer to join our team working on the MRI suite of products.As a Software Engineer, you will be responsible for developing, testing, and maintaining software solutions throughout the Software Development Lifecycle.You should...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    Job DescriptionJob DescriptionRoles and Responsibilities- Operate as a start-up within a highly influential InsurTech company- Drive engineering best practices such as TDD and GitOps- Lead the team in architecture and design discussions, and represent the team in cross company architecture decisions- Partner with product management and engineering leadership...

  • Senior Software Engineer

    3 days ago

    Bengaluru, Karnataka, India SLK Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Software Engineer AI IntegrationRole OverviewThe Senior Software Engineer AI Integration at one of SLK Fintech client who acts as the critical link between AI and real-world implementation. This professional is responsible for designing, connecting, and delivering robust, end-to-end pipelines that integrate AI models and agentic workflows into...

  • Senior Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Guidewire Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SummaryAs a Software Engineer at Guidewire, you're part of a distributed team helping change the face of insurance by creating technology that shapes the future of the property and casualty industry. With over 3000+ team members working on a large-scale platform, your role is crucial in giving insurers the cutting-edge tools they need to take care of their...

  • Software Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India Calpion Software Technologies Full time

    Job DescriptionRole Responsibilities:1. Lead and mentor engineering teams to deliver healthcare software solutions2. Collaborate with product and design teams to define roadmaps and priorities3. Ensure timely delivery and quality across the SDLC4. Mitigate technical risks and drive continuous improvementKey Deliverables:1. High-performing and engaged...

  • Lead Software Development Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Razorpay Software Private Limited Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Razorpay was founded by Shashank Kumar and Harshil Mathur in 2014. Razorpay is building a new-age digital banking hub (Neobank) for businesses in India with the mission is to enable frictionless banking and payments experiences for businesses of all shapes and sizes. What started as a B2B payments company is processing billions of dollars of payments for...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Spigot Software Full time

    This role of Senior Software Engineer is our client. The group is responsible for the development of the technology platforms supporting key products including Connected Risk, World Check, and products in the Risk Managed Services space.Responsible for the analysis, definition, design, construction, testing, installation, modification, and maintenance of...

  • Lead Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India JPMC Candidate Experience page Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking - Architecture and Engineering, you play a crucial role in an agile team dedicated to enhancing, building, and delivering trusted, market-leading...

  • Lead Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Ecolab Global Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Overview:The Lead Software Engineer is responsible for leading a team of developers in designing, developing, and delivering high-quality software solutions. This role involves hands-on coding, architecture design, mentoring junior engineers, and collaborating with cross-functional teams to ensure scalable, secure, and efficient applications.Key...