Data Engineer

3 weeks ago

Kurnool, India Digitalzone Full time

About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbtBuild and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservicesLeverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimizationDesign and manage data storage solutions with PostgreSQL, ClickHouse and ElasticsearchDefine and implement data modeling best practices for efficient and scalable data storage.Ensure high availability, performance, and security of data infrastructure on AWS cloudDesign and implement BI-ready datasets in ClickHouse optimized for OLAP workloads and reporting use cases.Develop and manage denormalized schemas and data models to support analytics and amCharts-based reporting.Optimize query performance, partitioning, and indexing strategies in ClickHouse to handle large-scale analytical workloads.Implement best practices for data quality, validation, and observabilityWork on data ingestion using Airbyte or other connector frameworksImplement data transformation pipelines supporting analytical and ML workloadsCollaborate with cloud and DevOps teams for containerized deployments (Docker, Kubernetes, AWS)Support integration of ML workflows and model APIs into production pipelines Qualifications6+ years of hands-on experience in data engineering and distributed systems.Required SkillsExperience with AI-assisted coding tools (Claude Code, GitHub Copilot, Cursor AI)Strong expertise in ClickHouse for analytics, including data modeling, partitioning, indexing, and query optimization.Proven ability to design and manage denormalized OLAP datasets to support BI and reporting workloads.Solid understanding of ETL/ELT pipelines and experience with tools such as Airbyte, DBT, Airflow or Python-based transformations.Proficiency in SQL (advanced queries, performance tuning, window functions, aggregations).Hands-on experience working with reporting/visualization frameworks (e.g., amCharts or similar libraries).Strong foundation in data quality, governance, and validation to ensure reliable analytics.Strong knowledge of real-time data streaming (Kafka, Spark)Experience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)Exposure to ML model integration, MLOps is a strong plusStrong problem-solving, debugging, and cross-team collaboration skills Preferred SkillsExperience with relational and analytical databases (Postgres, ClickHouse, Elasticsearch)Exposure to ML model integration, MLOps is a strong plus

  • Cloud Data Engineer

    1 week ago

    kurnool, India beBeeData Full time

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. This role requires expertise in data management, cloud infrastructure, and software development.Key Responsibilities:Designing and developing scalable data pipelines using cloud-based technologies.Implementing data processing and analytics solutions on Google Cloud...

  • Lead Data Engineer

    2 weeks ago

    Kurnool, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth Management Location: [Noida/Gurgaon/Remote] Experience: 10+ years Must Have: Wealth Management Domain, Fabric, Data Lake, Python Job Summary: We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions....

  • Senior data engineer

    3 weeks ago

    Kurnool, India Quantiphi Full time

    Role: Senior Data Engineer Experience Level: 4 to 7 Years Work location: Mumbai, Bangalore, Trivandrum (Hybrid Only) Required Skills: ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing...

  • Kafka Connect Data Engineer

    5 days ago

    Kurnool, India Philodesign Technologies Inc Full time

    Job Title: Kafka Connect Data Engineer Experience: 5 Years Work Mode: Remote Budget: ₹70,000 per month 🔍 About the Role We are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform. You will work closely with our Data...

  • Ai/ml & data engineer

    4 weeks ago

    Kurnool, India Mindfire Solutions Full time

    About the Job We are looking for an experienced AI/ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional teams to deliver AI-driven solutions, integrate large language models (LLMs), and optimize data workflows while ensuring security, scalability, and...

  • Senior Azure Data Engineer

    6 days ago

    Kurnool, India Tata Consultancy Services Full time

    Greetings from TCS! Job Title: Senior Data Engineer (Azure/SSIS) Location: PAN INDIA Experience Range: 7-14 years. Required Skillset: 1. Minimum 6 yrs of experience in building ETL pipeline using Azure data Factory, Azure Synapse 2. Minimum 6 yrs of ETL development using PL/SQL 3. Exposure in Azure data brick is added advantage 4. Above average communication...

  • Data Scientist

    3 weeks ago

    Kurnool, India Whatjobs IN C2 Full time

    Looking for Data Scientist | Gurgaon to join a team of rockstar developers. The candidate should have a minimum of 8yrs of experience. About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and we cater...

  • AWS, Snowflake, DBT, Terraform- Senior Data Engineer

    2 weeks ago

    Kurnool, India COREDATA CONSULTANCY Full time

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...

  • Data Scientist

    1 week ago

    Kurnool, India Talentgigs Full time

    Role: Data Scientist Experience: 6+ Years Location: HYD (WFO) Mandatory Skills: Python, Machine Learning Frameworks(e.g., TensorFlow, PyTorch is a plus), SQL, data visualization tools. JD: Role Overview: We are looking for a skilled Data Scientist with3 –6 years of experience who can turn data into actionable insights using machine learning, statistical...

  • Senior data engineer

    1 week ago

    Kurnool, India Armakuni Full time

    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you Roles and Responsibilities: · Experience working with AWS...