Data Engineer for Large-Scale Data Solutions

1 week ago


Bengaluru, Karnataka, India Observe Full time
Observe.AI: Boosting Contact Center Performance with Live Conversation Intelligence

About Us

We're the fastest way to enhance contact center performance, leveraging our cutting-edge AI engine. With Observe.AI, you'll uncover valuable insights from 100% of customer interactions and optimize frontline team performance through coaching and end-to-end workflow automation.

Our innovative solution is trusted by hundreds of customers and partners, including Pearson, Accolade, Group 1 Automotive, Southeast Trans, and Public Storage. We've raised $125 million in Series C funding led by Softbank Vision Fund 2, bringing our total funding to date to $213M, with investments from Menlo Ventures, Next47, NGP Capital, Emergent Ventures, Scale Ventures, Nexus Ventures, and Y-Combinator. For more information, visit www.observe.ai.

The Opportunity

We're seeking an experienced Data Engineer to lead the design and development of scalable data solutions. This critical role involves building robust data pipelines, optimizing data systems, and enabling analytics across the organization. As a senior member of the team, you'll collaborate closely with cross-functional stakeholders and mentor junior engineers.

Job Description:

  • Data Pipeline Development: Design, implement, and maintain scalable ETL/ELT pipelines for batch and real-time data processing.
  • Data Infrastructure: Architect and optimize large-scale distributed data systems for performance, reliability, and scalability.
  • Data Observability: Track and manage the lifecycle of data paths across the systems. Develop systems to measure and track quality, reliability, lineage, etc.
  • Data Modeling: Develop and manage data models and schemas to support analytics and machine learning workloads.
  • Code Quality: Write clean, maintainable, and efficient code following best practices for data engineering. Conduct code reviews and enforce coding standards.
  • Collaboration: Work with data scientists, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.
  • Mentorship: Guide and mentor junior engineers, fostering a culture of continuous learning and improvement.
  • Innovation: Research and implement emerging technologies and practices in data engineering to improve efficiency and innovation.

Required Skills and Qualifications:

  • Experience: 6+ years of professional experience in data engineering, with a strong focus on building large-scale data solutions.
  • Programming: Proficiency in Go, and Java. Experience with building reusable frameworks powering for managing data and infrastructure.
  • Frameworks: Expertise in data processing frameworks like Apache Spark, Kafka, or Flink.
  • Cloud Platforms: Hands-on experience with cloud ecosystems (AWS, Azure, or GCP), including data services like S3, Redshift, BigQuery, or Snowflake.
  • Databases: Strong understanding of relational and NoSQL databases (e.g., MongoDB, Cassandra, Amazon RDS).
  • Tools: Proficiency in data orchestration tools such as Temporal or Airflow. Also, data cataloging tools like Amundsen and data observability mechanisms.
  • Data Warehousing: Deep knowledge of modern data warehouse design and management.
  • Version Control: Experience with Git and CI/CD pipelines.
  • Soft Skills: Excellent problem-solving, communication, and collaboration skills.

Benefits:

  • Excellent medical insurance options and free online doctor consultations.
  • Yearly privilege and sick leaves as per Karnataka S&E Act.
  • Generous holidays (National and Festive) recognition and parental leave policies.
  • Learning & Development fund to support your continuous learning journey and professional development.
  • Fun events to build culture across the organization.
  • Flexible benefit plans for tax exemptions (i.e. Meal card, PF, etc.).

Estimated Salary Range: $150,000 - $200,000 per year.

Our Commitment to Inclusion and Belonging: We're an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. We strictly prohibit harassment of any kind and strive for a healthy and safe workplace. We welcome all people and celebrate diversity of all kinds, committed to creating an inclusive culture built on a foundation of respect for all individuals.



  • Bengaluru, Karnataka, India CygnusPro Software Solutions Pvt. Ltd Full time

    Estimated salary: ₹30,00,000 - ₹40,00,000 per annumAbout CygnusPro Software Solutions Pvt. Ltd.We are a leading software solutions company that specializes in providing innovative data engineering services to our clients. Our team of experts is dedicated to delivering high-quality solutions that meet the evolving needs of businesses.Job Description:Data...


  • Bengaluru, Karnataka, India McLaren Strategic Solutions (MSS) Full time

    Unlock Your Potential as a Data Engineer with McLaren Strategic SolutionsAre you passionate about building efficient, large-scale data pipelines using distributed technologies like Hadoop and Spark? Do you have strong software engineering experience in Python, Scala, Java or equivalent?We are seeking an experienced Data Engineer to join our team at McLaren...


  • Bengaluru, Karnataka, India ANSR Full time

    Job Overview">This role is responsible for designing and developing large-scale analytics solutions using data engineering principles. The ideal candidate will have a strong understanding of data architecture, solution design, and development best practices.


  • Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    o9 Solutions, Inc. is a cutting-edge technology company that digitally transforms planning and decision-making for enterprises and the planet. We are seeking an experienced Data Architect to join our team in Dallas.As a Data Architect at o9 Solutions, you will play a crucial role in designing and implementing large-scale cloud solutions using Spark, Delta...


  • Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full time

    Company OverviewPureSoftware Pvt Ltd. is a leading technology company that empowers businesses to drive innovation and growth through cutting-edge solutions.Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and delivering large-scale...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...


  • Bengaluru, Karnataka, India Talent500 Full time

    Talent500 Seeks Data Engineer for Large-Scale AnalyticsEstimated salary range: $150,000 - $200,000 per year.About the Role:We are seeking an experienced Data Engineer to join our team at Talent500. As a key member of our analytics department, you will be responsible for designing and developing large-scale analytics solutions using Snowflake, dbt Cloud, and...


  • Bengaluru, Karnataka, India Travash Software Solutions Private Limited Full time

    Job SummaryWe are seeking an experienced Hadoop expert to join our team at Travash Software Solutions Private Limited. As a Senior Data Engineer, you will play a key role in managing large-scale data storage and processing systems.About the RoleThe successful candidate will have 6+ years of experience in information technology and a minimum of 3-5 years of...


  • Bengaluru, Karnataka, India ADCI - Karnataka - A66 Full time

    Amazon Dev Center India - Hyderabad is seeking a highly skilled Data Engineer to join the eCS Data Engineering and Analytics team.About the RoleThis is a unique opportunity to own the architecture of DW solutions for the Enterprise using multiple platforms. As a Data Engineer, you will design, create, and manage extremely large datasets working backwards...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job DescriptionWe are seeking an experienced KDB developer to join our team in Bangalore, India. As a key member of our development team, you will be responsible for designing and implementing large-scale systems using KDB+, Linux, Shell, and CI/CD tools.About the Role:You will work on developing complex algorithms and engineering large systems with...


  • Bengaluru, Karnataka, India Infoblox Full time

    About the RoleAs a Staff Data Engineer at Infoblox, you will play a key role in developing platforms and products for our SaaS product line, delivering next-level networking for our customers.This is an exciting opportunity to work closely with data scientists and product teams to curate and refine data powering our latest cloud products.Key...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the Role:We are seeking a highly skilled Snowflake developer to join our team at Tata Consultancy Services.Responsibilities: Design and implement large-scale data intelligence solutions using Snowflake as the primary data warehousing platform.Develop and maintain complex SQL queries, stored procedures, and tasks to ensure efficient data processing and...


  • Bengaluru, Karnataka, India Altimetrik Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Altimetrik in Bangalore. As a Data Engineer, you will play a critical role in designing and developing large-scale data warehousing solutions.ResponsibilitiesDesign and develop ETL jobs across multiple platforms using AWS services like S3, Redshift, EMR, Lambda, Athena, and Glue.Develop...


  • Bengaluru, Karnataka, India Luxoft Full time

    Job SummaryWe are seeking a Senior Data Ops Engineer to develop a scalable data collection, storage, and distribution platform. The ideal candidate will have expertise in Snowflake and AWS, as well as experience with web scraping, containerization, and DevOps.Key ResponsibilitiesDesign and implement large-scale data platforms using Snowflake and AWSDevelop...


  • Bengaluru, Karnataka, India NETSACH GLOBAL Full time

    About the RoleWe are seeking an experienced Data Architect to join our team at Netsach Global, a leading Cyber Security Company. The ideal candidate will have a strong background in designing and developing large-scale data processing systems and architecture.Key ResponsibilitiesDesign, implement, and manage big data infrastructure and architecture to ensure...


  • Bengaluru, Karnataka, India Cardinal Health Full time

    At Cardinal Health, we are seeking an experienced Data Engineer to join our team in Dublin, Ohio. This is a unique opportunity to work with a global healthcare leader, driving innovation and business growth through data-driven solutions.About Us:We are a Fortune 500 company with over 50,000 employees worldwide. Our commitment to excellence has earned us...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India CodeVyasa Full time

    Looking for a Senior Data Engineer to join our team in Bangalore. The ideal candidate should have at least 2+ years of experience in large-scale data processing and data pipeline development.We are a multinational software company, CodeVyasa, that is growing rapidly with offices in Florida and New Delhi. Our clientele spans across the US, Australia, and...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. As a key member of our team, you will play a crucial role in designing and implementing data pipelines, ensuring high-quality data for business insights.About the RoleThis is an exciting opportunity to work with cutting-edge technology and contribute to the growth...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    NTT DATA Services is seeking a highly skilled Integration and DevOps Expert to join our team in Bangalore, India. As a key member of our organization, you will be responsible for designing and implementing large-scale Java projects using Agile/Scrum methodologies.We offer a competitive salary of $120,000 per year, based on the national average for software...