Data Engineer

2 days ago

guntur, India Digitalzone Full time

About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbtBuild and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservicesLeverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimizationDesign and manage data storage solutions with PostgreSQL, ClickHouse and ElasticsearchDefine and implement data modeling best practices for efficient and scalable data storage.Ensure high availability, performance, and security of data infrastructure on AWS cloudDesign and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases.Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting.Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads.Implement best practices for data quality, validation, and observabilityWork on data ingestion using Airbyte or other connector frameworksImplement data transformation pipelines supporting analytical and ML workloadsCollaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS)Support integration of ML workflows and model APIs into production pipelinesQualifications6+ years of hands-on experience in data engineering and distributed systems.Required SkillsExperience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI)Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization.Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads.Solid understanding of ETL/ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations.Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations).Hands-on experience working with reporting/visualization frameworks (e.g., amCharts or similar libraries).Strong foundation in data quality, governance, and validation to ensure reliable analytics.Strong knowledge of real-time data streaming (Kafka, Spark)Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)Exposure to ML model integration, MLOps is a strong plusStrong problem-solving, debugging, and cross-team collaboration skillsPreferred SkillsExperience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)Exposure to ML model integration, MLOps is a strong plus

  • Data Engineer

    26 minutes ago

    Guntur, India BayOne Solutions Full time

    The Opportunity:We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end...

  • Data engineer

    6 days ago

    Guntur, India Straive Full time

    Job Title: Data Engineer Location: Remote Job Type: Full time Years of Experience- 6-9 years About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered Operations and Education & Learning form the...

  • Data Engineering Expert

    1 day ago

    guntur, India beBeeData Full time

    Data Engineer Role OverviewAbout the JobAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.Main ResponsibilitiesData Pipeline Development: Develop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt to ensure seamless data flow.Real-Time Streaming:...

  • Lead data engineer

    3 days ago

    Guntur, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth Management Location: (Noida/Gurgaon/Remote) Experience: 10+ years Must Have: Wealth Management Domain, Fabric, Data Lake, Python Job Summary: We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions....

  • Lead data engineer

    4 days ago

    Guntur, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth Management Location: (Noida/Gurgaon/Remote) Experience: 10+ years Must Have: Wealth Management Domain, Fabric, Data Lake, Python Job Summary: We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions....

  • Azure Senior Data Engineer

    7 days ago

    Guntur, India Whatjobs IN C2 Full time

    Greetings from TCS!!!! TCS is hiring for AWS Data Engineer Experience : 5 to 10yrs Location: Pan India Mode of Driving : Virtual Date: 15-Nov-25 (Saturday) Job Description: Technical Experience 4+ years’ experience in Data Platform Engineering Extensive coding experience including Python/Pyspark Experience developing in Azure with key data technologies...

  • ▷ Urgent: Senior Data Engineer

    1 week ago

    Guntur, India Guidanz Inc Full time

    About BI Connector BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL. Our Data Architecture and Reporting Solutions team extends this mission by helping enterprises unlock the full value of their Oracle Fusion ERP, SCM, HCM data...

  • Senior Python Data Engineer

    2 weeks ago

    Guntur, India PriceEasy AI Full time

    About the jobAbout PriceEasy:Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advanced technologies. With a robust, innovative platform trusted by top companies globally, we are at the forefront of revolutionizing how...

  • Senior Data Engineer

    2 weeks ago

    Guntur, India Xped pvt Ltd Full time

    JOB DESCRIPTION :Responsibilities : - Collaborate with Data Engineers and Data Scientists to integrate and process structured and unstructured data sets into actionable insights.- Optimize PySpark jobs and data pipelines for performance, scalability, and reliability.- Conduct regular financial risk assessments to identify potential vulnerabilities in data...

  • Azure data engineer

    1 week ago

    Guntur, India Techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Azure Data Engineer Location:...