Senior Software Engineer – Cloud Data Pipeline

1 month ago


Bengaluru, India Calix Full time
This position is based in Bangalore, India.

Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks.

As part of a high performing global team, the right candidate will play a significant role as Calix Cloud Data Engineer involved in architecture design, implementation, technical leadership in data ingestion, extraction, and transformation domain.

Responsibilities and Duties:

  • Work closely with Cloud product owners to understand, analyze product requirements and provide feedback.
  • Architecture design and review of Cloud data pipeline, including data ingestion, extraction, and transformation services.
  • Implement and enhance support tools for monitoring and acting on data pipeline issues and interpret trends and patterns.
  • Technical leadership of software design in meeting requirements of service stability, reliability, scalability, and security
  • Guiding technical discussions within engineer group and making technical recommendations
  • Design review and code review with peer engineers
  • Guiding testing architecture for large scale data ingestion and transformations.
  • Customer facing engineering role in debugging and resolving field issues.

Qualifications:

  • 7-10 years of software engineering experience
  • 4+ years of development experience performing ETL and/or data pipeline implementations.
  • Organized and goal-focused, ability to deliver in a fast-paced environment.
  • Strong understanding of distributed systems and Restful APIs.
  • Experience in cloud-based big data projects (preferably deployed in either AWS or Azure)
  • Hands on experience implementing data pipeline infrastructure for data ingestion and transformation near real time availability of data for applications, BI analytics, and ML pipelines.
  • Working knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro) and query engines (Athena, Presto, Dremio) and associated concepts for building optimized solutions at scale.  
  • Experience in designing data streaming and event-based data solutions (Kafka, Kinesis, or like)
  • Experience building data pipelines (Flink, Spark or like)
  • Working experience with the cloud-based data warehouse like (Greenplum, RedShift, Azure SQL Data Warehouse, etc.)
  • Experience designing cost optimized solutions for large datasets using open-source frameworks.
  • Knowledge and experience designing solutions with cloud-native AWS Cloud services (EC2, EMR, RDS, EKS etc.) as well as deploying alternative solutions for appropriate use cases.
  • Expert level in one of the following programming languages or similar- Python, Java.
  • BS degree in Computer Science, engineering, or mathematics or equivalent experience.

Location:

  • Bangalore, India



  • Bengaluru, India Calix Full time

    This position is based in Bangalore, India.Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks.As part of a high...


  • Bengaluru, India Calix Full time

    This position is based in Bangalore, India.Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks.As part of a high...


  • Bengaluru, India Calix Full time

    This position is based in Bangalore, India.Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks.As part of a high...


  • Bengaluru, India EagleView Full time

    Role : Sr. Software Engineer, Data PipelinesAbout the company :Mixing technology, data, and first-in-class innovation, EagleView is not only leading the property data analytics market, but also changing lives along the way. Come join us and make great things happen!EagleView is a fast-growing technology company driving game-changing innovation in...

  • Staff Engineer

    2 weeks ago


    Bengaluru, India shenzyn Full time

    About the job :-Looking for an experienced Sr. Software Engineer to design, develop, and maintain mission- critical at-scale cloud-based geospatial data pipelines and data management environments.- Ideal candidates will have worked in a similar capacity as part of a high technology and/or data products company developing highly scalable data pipelines in the...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India Recrud Full time

    Recrud is proud to partner with a dynamic SaaS startup to scout for a skilled Data Engineer, adept in crafting robust data pipelines.This role is integral to the client's team, demanding a candidate with a minimum of 5 years of dedicated experience in the field.Position Overview :The Data Engineer will be a crucial part of the startup's technical...

  • Senior Data Engineer

    3 hours ago


    Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: BangaloreWorking: HybridSummary of Essential Job Functions- Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.- Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud Platform.-...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, India Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...


  • Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data EngineerJob Location: Bangalore Working: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Senior Data Engineer

    20 hours ago


    Bengaluru, India [24]7.ai Full time

    Job Role: Senior– Data Engineer Job Location: Bangalore Working: Hybrid Summary of Essential Job Functions Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow. Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...


  • Bengaluru, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...


  • Bengaluru, India Recro Full time

    Position: Senior Data EngineerLocation: BangaloreType: Full-TimeExperience Level: 4.5+ yearsJob Description:We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean, high-quality data...


  • Bengaluru, India NoBroker.com Full time

    Job Title : Senior DevOps EngineerLocation: BengaluruWe are seeking a highly skilled Senior DevOps Engineer to join our dynamic team. The ideal candidate should have extensive experience in creating and managing CI/CD pipelines, cloud infrastructure, Kubernetes, and proficiency in either Azure or Google Cloud Platform (GCP). As a Senior DevOps Engineer, you...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, India ZoomInfo Full time

    Senior Data EngineerPosition: Senior Data EngineerLocation: BangaloreExperience : 7-10 YearsAbout the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a developer and...

  • Principal Associate

    3 weeks ago


    Bengaluru, India Eurofins Full time

    Job DescriptionTITLE: Senior Data Engineer – Information Security (Service Delivery Management)Reporting To: ManagerLocation: BangaloreOVERALL OBJECTIVES:Eurofins today is strengthening the Information Security Reporting area. The crew is responsible for designing the data pipelines, creation and maintenance of reports that are used by several IT...


  • Bengaluru, India CIEL HR Services Full time

    Description:Title: Senior Cloud Data EngineerLocation: BangaloreTop Skills:1. Python and Pyspark2. SQL ( must able to write complex sql)3. Working knowledge with primary AWS Services like Glue, Airflow, DMS, Cloudwatch, cloudformation.4. Database: Redshift, AuroraResponsibilities:• Design, implement, and support various database services of our Cloud...


  • Bengaluru, India Avis Budget Group (ABG) Full time

    Role: Senior Engineer Job Summary : The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...

  • Senior Cloud Engineer

    2 weeks ago


    Bengaluru, India Avis Budget Group (ABG) Full time

    Role: Senior EngineerJob Summary:The Technology Transformation team in Avis is a technology specialist team to roll out new capabilities into the cloud to support engineers, analysts, and business teams. This role does NOT require night shifts but need to have overlapping hours between IST and US east morning hours for proper hand holding with...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, India Rakuten Symphony Full time

    Job BriefOur Data Platform team is building a world-class autonomous data service platform to cater services such as data lake as a service, database as a service, data transformation as a service and AI services.We are looking for a Data Engineer to help us build functional systems for our data platform services.For our autonomous data platform services as...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, India Recro Full time

    Position: Senior Data EngineerLocation: BangaloreType: Full-TimeExperience Level: 4.5+ yearsJob Description:We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean, high-quality data...