Staff Software Engineer – Cloud Data Pipeline

7 days ago

Bengaluru, Karnataka, India Calix Full time US$ 1,20,000 - US$ 2,00,000 per year
Calix is leading a service provider transformation to deliver a differentiated subscriber experience around the Smart Home and Business, while monetizing their network using Role based Cloud Services, Telemetry, Analytics, Automation, and the deployment of Software Driven Adaptive networks.

As part of a high performing global team, you will play a significant role as Calix Cloud Data Engineer involved in architecture design, implementation, technical leadership in data ingestion, extraction, and transformation domain.

Responsibilities and Duties:

  • Technical leadership in all phases of software design and development in meeting requirements of service stability, reliability, scalability, and security.
  • Hiring, training, provide technical direction and lead discussions and coordinate deliverables across multiple engineering teams globally.
  • Work closely with Cloud product owners to understand, analyze product requirements, provide feedback, coordinate resources and deliver a complete solution.
  • Drive evaluation and selection of best fit, efficient, cost-effective solution stack for the Calix Cloud data platform.
  • Drive development of scalable data pipeline infrastructure and services for enabling operationally efficient analytics solutions for Calix Cloud suite of products.
  • Create and extend data lake solution to enable data science workbenches and implement quality systems to ensure data quality, consistency, security, compliance, and lineage.
  • Drive continuous optimization of the data pipelines with automation, and tools.
  • Have a Test first mindset and use modern DevSecOps practices for Agile development.
  • Collaborate with senior leadership to translate platform opportunities into an actionable roadmap, track progress, and deliver new platform capabilities on-time and on-budget.
  • Triage and resolve customer escalations and technical issues.

Qualifications:

  • 10 + years of highly technical, hands-on software engineering experience with at least 7 years of Cloud based solution development
  • Strong, creative problem-solving skills and ability to abstract and share details to create meaningful articulation.
  • Passionate about delivering high quality software solutions and enabling automation in all phases.
  • Good understanding of big data engineering challenges and proven experience with data platform engineering (batch and streaming, ingestion, storage, processing, management, governance, integration, consumption patterns)
  • Experience in designing and performance tuning batch-based, low latency real-time streaming and event-based data solutions (Kafka, Spark, Flink or similar frameworks).
  • Practical experience of architecting with GCP Cloud platform and services and especially the Data ecosystem: BigQuery, Datastream, DataProc, Composer etc.
  • Deep understanding of Data Cataloging, Data Governance, Data Privacy principles and frameworks to integrate into the Data engineering flows.   
  • Advanced knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro) and query engines and associated concepts for consumption layers.
  • Experience implementing solutions that adhere to best practices and guidelines for different privacy and compliance practices around data (GDPR, CCPA).
  • Hands on expert level on one or more of the following programming languages - Python, Java
  • Organized and goal-focused, ability to deliver in a fast-paced environment.
  • BS degree in Computer Science, Engineering, Mathematics, or relevant industry standard experience to match

Location:

  • India – (Flexible hybrid work model - work from Bangalore office for 20 days in a quarter)

  • Sr. staff data engineer

    2 days ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 5+ years Role Summary: Aurigo is leading the charge in transforming enterprise Saa S for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Sr. Staff Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 7+ yearsRole Summary: Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Sr. Staff Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 9+ yearsRole Summary:Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Sr. Staff Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer) Location: Bengaluru, India Experience: 9+ years Role Summary : Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks,...

  • Staff Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Harness Full time US$ 1,50,000 - US$ 2,00,000 per year

    Harness is a high-growth company that is disrupting the software delivery market. Our mission is to enable the 30 million software developers in the world to deliver code to their users reliably, efficiently, securely and quickly, increasing customers' pace of innovation while improving the developer experience. We offer solutions for every step of the...

  • Cloud Data Pipeline Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    AWS Data Engineer PositionJob Title: AWS Data EngineerKey Responsibilities:To design, build and maintain scalable data pipelines for the cloud-based platform AWS.Implement data ingestion and transformation processes to facilitate efficient data warehousing using AWS services.We are looking for an expert in data engineering with experience in cloud...

  • GCP Staff Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role – GCP Staff Data EngineerExperience: 8 - 13 yearsNotice Period: Immediate to max 45 daysPreferred - Data Engineering BackgroundLocation –Bangalore, Chennai, Hyderabad, Kolkata, Pune, GurgaonRequired Skills - GCP DE Experience, Big query, SQL, Cloud compressor/Python, Cloud functions, Dataproc+pyspark, Python injection, Dataflow+PUB/SUBJob...

  • GCP Staff Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role – GCP Staff Data EngineerExperience: 8 - 13 yearsNotice Period: Immediate to max 45 daysPreferred - Data Engineering BackgroundLocation –Bangalore, Chennai, Hyderabad, Kolkata, Pune, GurgaonRequired Skills - GCP DE Experience, Big query, SQL, Cloud compressor/Python, Cloud functions, Dataproc+pyspark, Python injection, Dataflow+PUB/SUBJob...

  • Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Spectro Cloud Full time

    Who We Are Spectro Cloud aims to make infrastructure boundaryless for the enterprise from data center to edge and every platform in between We provide solutions that help enterprises run applications on Kubernetes their way anywhere Established by a team of multi-cloud management experts and industry veterans with a track record of success we re at...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Axiom Software Solutions Limited Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer - TCSCompany: Axiom Software Solutions LimitedType: PermanentLocation: United KingdomJob Description:Axiom Software Solutions Limited is seeking a skilled Data Engineer to join our team in a permanent capacity. The ideal candidate will have significant experience in building scalable data pipelines and contributing to data management...