Kafka Connect Data Engineer

5 days ago

Kurnool, India Philodesign Technologies Inc Full time

Job Title: Kafka Connect Data Engineer Experience: 5 Years Work Mode: Remote Budget: ₹70,000 per month 🔍 About the Role We are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform. You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems. 🛠 Key Responsibilities - Design, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations. - Build ingestion solutions from MySQL and PostgreSQL into AWS S3, Google Cloud Storage (GCS), and BigQuery. - Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture. - Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability. - Collaborate with teams to analyze source systems and define downstream data needs. - Optimize ingestion workflows for performance and cost efficiency. - Create automation and deployment scripts using Python and cloud-native tools. - Explore emerging data lake technologies like Apache Hudi and Apache Iceberg. ✅ Required Skills & Qualifications - Minimum 2+ years as a Data Engineer or similar role. - Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors). - Experience with Debezium for CDC (Change Data Capture). - Expertise in MySQL and PostgreSQL. - Working knowledge of AWS S3, GCP BigQuery, and GCS. - Proficient in Python for scripting and automation. - Understanding of data lake architectures, ETL/ELT pipelines, data quality, and observability. ✨ Good to Have - Experience with Docker / Kubernetes. - Familiarity with orchestration tools like Airflow or Dagster. - Knowledge of IaC tools such as Terraform or CloudFormation. - Exposure to Apache Hudi or Apache Iceberg (highly preferred). How to apply send your cv on priyanka.jadhav@philodesigntech.com

  • Data Engineer

    3 weeks ago

    Kurnool, India Digitalzone Full time

    About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbtBuild and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven...

  • AWS, Snowflake, DBT, Terraform- Senior Data Engineer

    2 weeks ago

    Kurnool, India COREDATA CONSULTANCY Full time

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...

  • Lead Data Engineer

    2 weeks ago

    Kurnool, India NexGen Tech Solutions Full time

    Job Title: Lead Data Engineer – Wealth Management Location: [Noida/Gurgaon/Remote] Experience: 10+ years Must Have: Wealth Management Domain, Fabric, Data Lake, Python Job Summary: We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions....

  • Senior data engineer

    1 week ago

    Kurnool, India Armakuni Full time

    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you Roles and Responsibilities: · Experience working with AWS...

  • Solace Engineer

    1 week ago

    Kurnool, India Whatjobs IN C2 Full time

    Company Description We suggest you enter details here. Role Description This is a full-time remote role for a SOLACE MESSAGING ENGINEER at EZ INFORMATICS SOLUTIONS PVT LTD. The role will involve troubleshooting messaging systems, providing technical support, and managing Microsoft Exchange infrastructure. Essential Skills (Two top skills) - Solace Messaging...

  • Cloud Data Engineer

    1 week ago

    kurnool, India beBeeData Full time

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. This role requires expertise in data management, cloud infrastructure, and software development.Key Responsibilities:Designing and developing scalable data pipelines using cloud-based technologies.Implementing data processing and analytics solutions on Google Cloud...

  • Data Platform Engineer – B2B Intelligence Systems

    3 weeks ago

    Kurnool, India BioSales Full time

    Data Platform Engineer – B2B Intelligence Systems (Life Sciences)Location: Remote | Type: Full-Time About BioSalesBioSales partners with contract research organizations (CROs) and life sciences companies to provide comprehensive sales and go-to-market services. We lead the entire sales process from prospecting new clients and closing deals to account...

  • Financial Domain: Full Stack Developer with.NET/C#/SQL, Python

    2 weeks ago

    Kurnool, India Vertus Enterprises Inc. dba CMIT Solutions, JCMCH Full time

    Company DescriptionVertus Solutions dba CMIT Solutions NYNJ (vertussolution.com) offers proactive and dependable technology and data solutions to businesses with 24/7 mission critical operations. Its comprehensive technology and security solutions enable clients to grow their business and protect from security threats, accidental damages and errors.Role...

  • Financial Domain: Full Stack Developer with.NET/C#/SQL, Python

    2 weeks ago

    Kurnool, India Vertus Enterprises Inc. dba CMIT Solutions, JCMCH Full time

    Company DescriptionVertus Solutions dba CMIT Solutions NYNJ (vertussolution.com) offers proactive and dependable technology and data solutions to businesses with 24/7 mission critical operations. Its comprehensive technology and security solutions enable clients to grow their business and protect from security threats, accidental damages and errors.Role...

  • Senior data engineer

    3 weeks ago

    Kurnool, India Quantiphi Full time

    Role: Senior Data Engineer Experience Level: 4 to 7 Years Work location: Mumbai, Bangalore, Trivandrum (Hybrid Only) Required Skills: ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing...