Data Engineer

3 weeks ago

Greater Bengaluru Area, India Kunato Full time

We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and decision-making. If you are passionate about building robust data infrastructure and enjoy working in a fast-paced environment, this role is for you



Key Responsibilities :


1. Design & Develop Scalable Data Pipelines: Architect and build efficient data ingestion pipelines that empower the business with timely and actionable insights to drive strategy and operations.

2. Collaborate with Cross-Functional Teams: Work closely with technical and business teams to gather requirements and translate them into technical specifications and solutions.

3. Optimize Data Architecture: Continuously refine and improve the performance, reliability, and scalability of data pipelines to ensure seamless integration of data across systems.

4. Ensure Data Integrity: Perform rigorous data quality checks and uphold best practices to maintain the accuracy, consistency, and integrity of data.

5. Build ETL Solutions: Develop ETL frameworks to collect, transform, and integrate data from diverse sources such as Kafka, Scylla, PostgreSQL, MongoDB, APIs, and various file formats.

6. Adopt Best Practices: Implement best-in-class engineering practices around reporting and analysis, ensuring data integrity, testing, validation, and comprehensive documentation.



Basic Qualifications :


1. Bachelor’s degree in Computer Science, Information Systems, or a related technical field, or equivalent work experience.


2. 3+ years of hands-on experience with cloud-based data technologies, including message queues, event grids, relational databases, NoSQL databases, data warehouses, and big data technologies (e.g., Spark).


3. Proficiency in Spark (Java, Python, SQL): Expertise in developing and optimizing Spark-based applications for large-scale data processing.


4. Advanced SQL Skills: Ability to create complex queries, manage database structures, and ensure optimal performance.


5. Experience with Docker and Kubernetes: Familiarity with deploying applications using modern containerisation and orchestration tools.


6. DevOps and CI/CD: Solid understanding of modern DevOps practices, including Git, continuous integration, and continuous deployment pipelines.


7. Agile Development Experience: Comfortable working in an Agile environment, particularly using Scrum methodology.



Preferred Qualifications


1. API Frameworks & OOP: Experience with API frameworks and object-oriented programming to integrate services and improve data workflows.


2. Business Acumen: Ability to collaborate closely with leadership to deliver innovative solutions tailored to evolving business needs.


3. Strong Communication Skills: Excellent verbal and written communication abilities, with a knack for explaining complex technical concepts to both technical and non-technical stakeholders.


4. Ability to leverage tools like langchain, llama index ..etc to build llm based applications.

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN: KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer...

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Kunato Full time

    We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...

  • Data Engineering Leader

    4 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at CodeVyasa.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:Data Pipeline Development: Design, implement, and...

  • Azure Data Engineer

    1 month ago

    Greater Bengaluru Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Azure Data Engineer

    1 month ago

    Greater Bengaluru Area, India TEKsystems Full time

    TEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...

  • Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Data Engineer

    1 week ago

    Greater Bengaluru Area, India TerraGiG Full time

    Role: Data Engineer Experience: 4-9 years Location: Bangalore Mandatory Skills: Python, PySpark, AWS (must be working in the current project) Job Responsibilities: Extensive hands-on experience in application development using Python , PySpark , and other programming languages. Proficient in building and deploying cloud-native solutions using AWS...

  • Data Engineer

    1 week ago

    Greater Bengaluru Area, India TerraGiG Full time

    Role: Data EngineerExperience: 4-9 yearsLocation: BangaloreMandatory Skills: Python, PySpark, AWS (must be working in the current project)Job Responsibilities:Extensive hands-on experience in application development using Python, PySpark, and other programming languages.Proficient in building and deploying cloud-native solutions using AWS services,...

  • Data Engineer

    3 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data Engineer Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our...

  • Data Engineer

    3 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data EngineerLocation: Hyderabad, India - Hybrid Remote (3 days a week in office preferred)Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our organization....

  • Senior Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • GCP Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...

  • GCP Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • Senior Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India Applicantz Full time

    THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is...

  • Senior Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that...