AI - Senior Data Engineer - Data Pipeline

About Us :

Observe.AI enables enterprises to transform how they connect with customers through AI agents and copilots that engage, assist, and act across every channel. From automating conversations to guiding human agents in real time to uncovering insights that shape strategy, Observe.

AI turns every interaction into a driver of loyalty and growth. Trusted by global leaders, were creating a future where every customer experience is smarter, faster, and more impactful.

Why Join U :

At Observe.AI, data engineering isnt just about moving dataits about building scalable systems that unlock insights and create real impact.

As a Senior Data Engineer, youll help modernize our data architecture, enable self-serve analytics, and deliver high-quality data products that power smarter decisions across the company.

Youll work on both batch and streaming systems, collaborating closely with product, analytics, and engineering leaders to ensure were solving the right data challenges the right way.

If youre looking for an opportunity where your ideas shape the future of data, your work fuels innovation, and your growth is supported by tackling meaningful challenges with a talented team, this is the place for you.

What Youll Be Doing :

- Build and maintain real-time and batch data pipelines using tools like Kafka, Spark, and Airflow.

- Contribute to the development of a scalable LakeHouse architecture using modern data formats such as Delta Lake, Hudi, or Iceberg.

- Contribute to building data products for inbound (ingestion) and outbound (consumption) use cases across the organization.

- Optimize data ingestion and transformation workflows across cloud platforms (AWS, GCP, or Azure).

- Support data quality, lineage, and observability using modern practices and tools.

- Participate in Agile processes (Sprint Planning, Reviews) and contribute to team knowledge sharing and documentation.

- Proficient in building pipelines on AWS, GCP, or Azure using managed services and cloud-native tools.

- Experience in Airflow or similar orchestration platforms.

- Strong in data modeling and optimizing data warehouses like Redshift, BigQuery, or Snowflake.

What Youll Bring To The Role :

- 7-9 years of experience in data engineering or backend systems with a focus on large-scale data pipelines.

- Working knowledge of LakeHouse formats (Delta/Hudi/Iceberg) and columnar storage like Parquet.

- Expertise in data modeling and optimizing data warehouses like Redshift, BigQuery, or Snowflake.

- Exposure to real-time OLAP tools like ClickHouse, Druid, or Pinot.

- Familiarity with observability tools such as Grafana, Prometheus, or Loki.

- Some experience integrating data with MLOps tools like MLflow, SageMaker, or Kubeflow.

- Bachelors or Masters Degree in Engineering.

Perks & Benefits :

- Excellent medical insurance options and free online doctor consultations.

- Yearly privilege and sick leaves as per Karnataka S&E Act.

- Generous holidays (National and Festive) recognition and parental leave policies.

- Learning & Development fund to support your continuous learning journey and professional development.

- Fun events to build culture across the organization.

- Flexible benefit plans for tax exemptions (i.e. Meal card, PF, etc.)

Our Commitment to Inclusion and Belonging :

Observe.AI is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce.

Observe AI does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender identity, sexual orientation, disability, age, military or veteran status, or any other basis protected by applicable local, state, or federal laws or prohibited by Company policy.

Observe.AI also strives for a healthy and safe workplace and strictly prohibits harassment of any kind.

We welcome all people. We celebrate diversity of all kinds and are committed to creating an inclusive culture built on a foundation of respect for all individuals.

We seek to hire, develop, and retain talented people from all backgrounds.

Individuals from non-traditional backgrounds, historically marginalized or underrepresented groups are strongly encouraged to apply.

If you are ambitious, make an impact wherever you go, and you're ready to shape the future of Observe.AI, we encourage you to apply.