Senior Staff Engineer

4 weeks ago

Bangalore, India TPG Search Full time

Job Description :


We are seeking a highly skilled and experienced Staff Engineer - Data Engineer, to join our data engineering team. The ideal candidate will have a strong background in designing, building, and maintaining data pipelines, with expertise in setting up and optimizing data processing frameworks such as Apache Spark or similar, Kafka/Pulsar and data lake

Responsibilities :

- Design and develop robust, scalable, and efficient data pipelines to collect, process, and store large volumes of data from various sources.

- Collaborate with platform and AI/ML teams to understand data requirements and supply data solutions like feature stores.

- Architect data pipelines platform for product in a multitenant design realm

- Design data solutions that scale dynamically based on the tenant data size, ranging from few GBs to TBs of data

- Manage and perfect data streaming and messaging platforms such as Kafka and Pulsar for real-time data ingestion.

- Work on data quality monitoring and ensure data accuracy, consistency, and reliability.

- Keep abreast of industry trends and emerging technologies related to data pipelines and recommend improvements.

- Build a centralized data lake that consolidates various data assets in the organization.

- Build and maintain the runtime environment for data processing, including platforms like SQL, Python, and PySpark.

Qualifications :

- Bachelor's or higher degree in Computer Science, Data Engineering, or a related field.

- Proven experience (6+ years) in data engineering in a production environment.

- Strong ability in setting up and configuring Apache Spark Flink or similar, Kafka/Pulsar, for data streaming, transformation, and processing.

- Hands-on experience with AWS services, including S3, Lambda, EMR, Glue, Redshift, Athena. Equivalent skills on GCP will also be highly rewarding

- Proven expertise across the entire lifecycle of implementing computer and orchestration tools like Databricks, Airflow, Dagster, and others.

- Proven expertise in setting data pipeline as platform for multi-tenant systems

- Accomplished in managing large-scale data sets, handling Terabytes of data and billions of records effectively.

- Skilled in working with streaming OLAP engines like Druid, ClickHouse, Pinot and similar technologies. Expertise with Apache Trino is a big plus

- Strong programming skills in languages such as Python or Scala

- Familiarity with service-oriented architecture and gRPC or similar

- Familiarity with high-security environments like SOC-2, HIPAA, PCI, or similar contexts, highlighting a commitment to data privacy and security.

- Strong team player and ability to collaborate with cross-functional teams.

- Results-oriented and able to work independently with minimal supervision.

- Excellent problem-solving and communication skills

(ref:hirist.tech)

  • Senior Mechanical Engineer

    4 weeks ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Staff/Senior Staff Engineer

    4 weeks ago

    bangalore, India MediaTek Full time

    Job DescriptionStaff/Senior Staff Engineer (physical design) – (5-10 years) M.E./M.Tech in Electronics/Electrical Engineering with minimum of 5 years of strong, hands on Physical Design experience. Must have handled Netlist to GDS II at Top level or Hierarchical top level. Any leadership experience is a plus. Should have experience in 28nm & below...

  • Senior Staff/Principal Engineer Embedded Memory Design

    4 weeks ago

    bangalore, India M31 Technology Full time

    Company DescriptionM31 Technology Corporation is a professional silicon intellectual property (IP) provider. With its headquarters in Hsinchu, Taiwan, M31 has substantial experiences in IP development, IC design, and electronic design automation fields. They specialize in providing high-speed interface IPs, memory compilers, and standard cell library...

  • Senior Staff Platform Engineer

    2 months ago

    bangalore, India SolarWinds Full time

    Your Role : We are seeking a Senior Staff Engineer to join our Developer Experience team in the SolarWinds Observability engineering org. Our goal is to help our developers succeed by providing an exceptional developer experience. You will work alongside other engineers in an agile development environment and share solutions to advance the technologies...

  • Senior Staff Design Engineer

    4 weeks ago

    bangalore, India Synopsys Inc Full time

    Senior Staff ASIC Digital Design EngineerWe're looking for a Senior ASIC Digital Design Engineer to join the team.Does this sound like a good role for you?You will be part of the Solutions Group at our Bangalore Design Center, India. This is a Technical Individual Contributor role and offers challenges to work in a multi-site environment on technically...

  • Edelman Financial Engines

    23 hours ago

    bangalore, India FENL IT SERVICES FINANCIAL ENGINES LLP Full time

    Senior Staff Engineer - Salesforce Development At Edelman Financial Engines (EFE), we believe everyone deserves to move their financial life forward!We know that assets have the power to fund goals. Those numbers represent individual lifetimes filled with hard work and dreams for our clients and generations to follow. Our clients trust us to guide them...

  • Edelman Financial Engines

    1 day ago

    Bangalore, India FENL IT SERVICES FINANCIAL ENGINES LLP Full time

    Senior Staff Engineer - Salesforce Development At Edelman Financial Engines (EFE), we believe everyone deserves to move their financial life forward!We know that assets have the power to fund goals. Those numbers represent individual lifetimes filled with hard work and dreams for our clients and generations to follow. Our clients trust us to guide them...

  • Staff Engineer

    4 weeks ago

    bangalore, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR48815 Staff Engineer - ASIC Design Verification...

  • Senior Staff Physical Design Engineers

    2 months ago

    bangalore, India Synopsys Inc Full time

    Senior Staff Physical Design EngineersLocation: BangaloreExperience: 8yrs - 15yrsOverview:Join a growing global team at Synopsys focused on advancing the state-of-the-art in High-Performance Cores implementation . The team is working on developing innovative methodologies to implement processors, i.e. CPUs/GPUs that can deliver more performance with lesser...

  • Senior Staff Engineer

    4 weeks ago

    Bangalore, India ETEROS TECHNOLOGIES PRIVATE LIMITED Full time

    Role Description :This is a full-time on-site role for a CAN/LIN Sr Staff EE Validation Engineer located in Bengaluru. As a CAN/LIN Sr Staff EE Validation Engineer, you will be responsible for the day-to-day tasks associated with electrical and electronic system validation. You will collaborate with cross-functional teams to ensure product compliance with...

  • Senior Staff Engineer

    4 weeks ago

    bangalore, India ETEROS TECHNOLOGIES PRIVATE LIMITED Full time

    Role Description :This is a full-time on-site role for a CAN/LIN Sr Staff EE Validation Engineer located in Bengaluru. As a CAN/LIN Sr Staff EE Validation Engineer, you will be responsible for the day-to-day tasks associated with electrical and electronic system validation. You will collaborate with cross-functional teams to ensure product compliance with...

  • Analog Design Engineer

    3 days ago

    bangalore, India MediaTek Full time

    Job DescriptionJob Overview: As a Senior Staff Design engineer, you will be part of a team with a charter to develop new SerDes IPs that solve our customers’ challenges.Responsibilities:* Design of High Speed SERDES products on leading-edge technology nodes* Design and development of analog/mixed signal IC circuit blocks from initial concept/specification...

  • Senior Staff Information Security Cloud Engineer

    4 weeks ago

    Bangalore, India HeadPro Consulting LLP Full time

    Job Title : Senior Staff Info security cloud engineerLocation : BangaloreExp : 12 - 15 YearsBudget : 40 - 60LPAMandatory skills :1. Need someone who have good experience in implementing & supporting information security enterprise level cloud based tools. 2. Candidate should have worked with cloud computing infrastructure architecture.3. Candidate should...

  • Senior Staff Information Security Cloud Engineer

    4 weeks ago

    bangalore, India HeadPro Consulting LLP Full time

    Job Title : Senior Staff Info security cloud engineerLocation : BangaloreExp : 12 - 15 YearsBudget : 40 - 60LPAMandatory skills :1. Need someone who have good experience in implementing & supporting information security enterprise level cloud based tools. 2. Candidate should have worked with cloud computing infrastructure architecture.3. Candidate should...

  • Senior/ Staff Engineer, PCB Design

    3 weeks ago

    bangalore, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR50725 Senior/ Staff Engineer, PCB Design Do you...

  • Senior Staff Software Engineer

    2 months ago

    bangalore, India Cloudera Full time

    Job Description :  At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation...

  • Senior Staff Engineer

    1 week ago

    Bengaluru/ Bangalore, India Nutanix Full time

    Apply for Senior Staff Engineer Development, Distributed Systems, Cloud [16 Years], Career Progress Consultants in Bengaluru/ Bangalore for 16 - 19 Year of Experience on TimesJobs.com.

  • Senior Staff Software Engineer

    2 months ago

    Bangalore, India MaxLinear Full time

    Responsibilities MaxLinear is seeking a Senior Staff Software Engineer to join our growing team. In this role, you will focus on the following: Work closely with the hardware engineering team in the development of Graphical User Interfaces Design and develop commercial software applications for customer use Create intuitive and responsive...

  • Senior Staff Software Engineer

    2 months ago

    bangalore, India MaxLinear Full time

    Responsibilities MaxLinear is seeking a Senior Staff Software Engineer to join our growing team. In this role, you will focus on the following: Work closely with the hardware engineering team in the development of Graphical User Interfaces Design and develop commercial software applications for customer use Create intuitive and responsive...

  • Senior Staff Engineer

    3 days ago

    bangalore, India Sumo Logic Full time

    Sr. Staff Software Engineer  Increasingly complex modern applications demand increasingly flexible and powerful tools in order to empower engineers to identify, resolve, investigate, and prevent issues and outages. This role targets a candidate with expertise in the development of large-scale tools for monitoring and troubleshooting of production...