Principal Software Engineer

2 days ago

Bengaluru, Karnataka, India Talent21 Management Shared Services Pvt. ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

What youll do:

We seek Software Engineers with experience building and scaling services in on-premises and cloud environments.

As a Principal Software Engineer in the Epsilon Attribution/Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop.

Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows. Perform data integration and transformation, troubleshoot issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine/forecasting engine.

Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies SCRUM.

Qualifications

What youll need:

  • Strong experience (12+ years) in Scala programming language and extensive experience with Apache Spark for Big Data processing for design, developing and maintaining scalable on-prem and cloud environments, especially on AWS and as needed with GCP cloud.
  • Proficiency in performance tuning of Spark jobs, optimizing resource usage, shuffling, partitioning, and caching for maximum efficiency in Big Data environments.
  • In-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.
  • Expertise in designing and implementing scalable, fault-tolerant data pipelines with end-to-end monitoring and alerting.
  • Using Python to develop infrastructure modules. Hence, hands-on experience with Python.
  • Solid grasp of database systems and SQLs for writing efficient SQLs (RDBMS/Warehouse) to handle TBS of data.
  • Familiarity with design patterns and best practices for efficient data modelling, partitioning strategies, and sharding for distributed systems and experience in building, scheduling and maintaining DAG workflows.
  • End-to-end ownership with definition, development, and documentation of softwares objectives, business requirements, deliverables, and specifications in collaboration with stakeholders.
  • Experience in working on GIT (or equivalent source control) and solid understanding of Unit and integration test frameworks.
  • Must have the ability to collaborate with stakeholders/teams to understand requirements and develop a working solution and the ability to work within tight deadlines and effectively prioritize and execute tasks in a high-pressure environment.
  • Must be able to mentor junior staff.

Advantageous to have experience on below:

  • Hands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues.
  • Proficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualization.
  • Strong background in analytics, including the ability to derive actionable insights from large datasets and support data-driven decision-making.
  • Experience with data visualization tools like Tableau, Power BI, or Grafana.
  • Familiarity with Docker for containerization and Kubernetes for orchestration.

Required Skills -

Kubernetes, analytics, SCRUM, written and verbal communication, Hadoop, Agile, HDFS YARN, SQLs, Docker, Grafana, data visualization, Scala programming language, SQL?s RDBMS Warehouse, containerization, Catalogues, Scala Spark, AWS, data driven, Python, Elasticsearch Logstash Kibana, Tableau Power BI, data, Big Data, Apache Spark, GCP cloud, orchestration, MapReduce, visualization, real.

  • Principal Software Engineer

    4 days ago

    Bengaluru, Karnataka, India Oracle Financial Services Software Ltd Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Principal Software Engineer (IC4) At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world. Values are OCI's foundation and how we...

  • Principal Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Principal Software Engineer At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world. Values are OCI's foundation and how we deliver...

  • Software Principal Engineer

    11 hours ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...

  • Principal Software Engineer

    7 hours ago

    Bengaluru, Karnataka, India NIKE Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    PRINCIPAL SITE RELIABILITY ENGINEERIndia Technology CenterWHO YOU WILL WORK WITHThe Principal Site Reliability Engineer will work alongside a talented team of Site Reliability Engineers focused on delivering reliabile and observable software used by millions of athletes* around the world. You will be a part of the Resilience Engineering organization which...

  • IT Principal Software Engineer

    6 days ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    IT Principal Software EngineerThe Software Engineering team delivers next-generation software application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering...

  • Software Principal Engineer

    10 hours ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description Software Principal Engineer The Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics all with the most advanced technologies, tools, software engineering...

  • Software Principal Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...

  • Software Principal Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...

  • Software Principal Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...

  • Software Principal Engineer

    1 week ago

    Bengaluru, Karnataka, India Dell Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...