Data Engineer

4 weeks ago

Greater Bengaluru Area, India Kunato Full time

We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and decision-making. If you are passionate about building robust data infrastructure and enjoy working in a fast-paced environment, this role is for you



Key Responsibilities :


1. Design & Develop Scalable Data Pipelines: Architect and build efficient data ingestion pipelines that empower the business with timely and actionable insights to drive strategy and operations.

2. Collaborate with Cross-Functional Teams: Work closely with technical and business teams to gather requirements and translate them into technical specifications and solutions.

3. Optimize Data Architecture: Continuously refine and improve the performance, reliability, and scalability of data pipelines to ensure seamless integration of data across systems.

4. Ensure Data Integrity: Perform rigorous data quality checks and uphold best practices to maintain the accuracy, consistency, and integrity of data.

5. Build ETL Solutions: Develop ETL frameworks to collect, transform, and integrate data from diverse sources such as Kafka, Scylla, PostgreSQL, MongoDB, APIs, and various file formats.

6. Adopt Best Practices: Implement best-in-class engineering practices around reporting and analysis, ensuring data integrity, testing, validation, and comprehensive documentation.



Basic Qualifications :


1. Bachelor’s degree in Computer Science, Information Systems, or a related technical field, or equivalent work experience.


2. 3+ years of hands-on experience with cloud-based data technologies, including message queues, event grids, relational databases, NoSQL databases, data warehouses, and big data technologies (e.g., Spark).


3. Proficiency in Spark (Java, Python, SQL): Expertise in developing and optimizing Spark-based applications for large-scale data processing.


4. Advanced SQL Skills: Ability to create complex queries, manage database structures, and ensure optimal performance.


5. Experience with Docker and Kubernetes: Familiarity with deploying applications using modern containerisation and orchestration tools.


6. DevOps and CI/CD: Solid understanding of modern DevOps practices, including Git, continuous integration, and continuous deployment pipelines.


7. Agile Development Experience: Comfortable working in an Agile environment, particularly using Scrum methodology.



Preferred Qualifications


1. API Frameworks & OOP: Experience with API frameworks and object-oriented programming to integrate services and improve data workflows.


2. Business Acumen: Ability to collaborate closely with leadership to deliver innovative solutions tailored to evolving business needs.


3. Strong Communication Skills: Excellent verbal and written communication abilities, with a knack for explaining complex technical concepts to both technical and non-technical stakeholders.


4. Ability to leverage tools like langchain, llama index ..etc to build llm based applications.

  • Data Engineer

    5 days ago

    Greater Bengaluru Area, India Capgemini Full time

    Location: PAN India Job Description (GCP Data Engineer): • Experience in GCP Data Engineering. • Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. • Should have worked on handling big data. • Strong communication skills. • experience in Agile methodologies ETL, ELT skills, Data movement...

  • Data Engineer

    6 days ago

    Greater Bengaluru Area, India Capgemini Full time

    Location: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...

  • Data Engineer

    1 month ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN: KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer...

  • Data Engineer

    1 month ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Data Engineer

    4 days ago

    Greater Bengaluru Area, India LTIMindtree Full time

    Mandatory Skills : ETL + Azure Databricks + PythonRoles/Responsibilities:Creating testing procedures to evaluate the performance of the data engineering PipelinesBuilding Data validation pipeline that automate testing processesRunning the Data pipelines testing procedures to evaluate the data pipelinesDocumenting all testing proceduresReporting bugs and...

  • Azure Data Engineer

    4 days ago

    Greater Bengaluru Area, India Torry Harris Integration Solutions Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Azure Data Engineer

    4 days ago

    Greater Bengaluru Area, India Torry Harris Integration Solutions Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level. As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India Kunato Full time

    We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...

  • Data Engineer Expert

    3 days ago

    Greater Bengaluru Area, India LTIMindtree Full time

    About the RoleWe are seeking a highly skilled Data Engineer Expert to join our team at LTIMindtree.The successful candidate will have a strong background in data engineering and experience with big data technologies like Hive, Spark, and Azure Databricks.Key ResponsibilitiesCreate testing procedures to evaluate the performance of data engineering...

  • Data Engineering Leader

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at CodeVyasa.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:Data Pipeline Development: Design, implement, and...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • Data Engineer

    4 days ago

    Greater Bengaluru Area, India DataNimbus Full time

    About DataNimbus:DataNimbus is a pioneering enterprise and payments modernization company, offeringinnovative solutions to orchestrate financial journeys for businesses worldwide. With anunwavering commitment to unlocking the value of automation and data science toincrease revenue and reduce operational costs and risks, DataNimbus is at the forefront...

  • Data Engineer

    2 days ago

    Greater Bengaluru Area, India DataNimbus Full time

    About DataNimbus: DataNimbus is a pioneering enterprise and payments modernization company, offering innovative solutions to orchestrate financial journeys for businesses worldwide. With an unwavering commitment to unlocking the value of automation and data science to increase revenue and reduce operational costs and risks, DataNimbus is at the forefront of...

  • Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India TerraGiG Full time

    Role: Data EngineerExperience: 4-9 yearsLocation: BangaloreMandatory Skills: Python, PySpark, AWS (must be working in the current project)Job Responsibilities:Extensive hands-on experience in application development using Python, PySpark, and other programming languages.Proficient in building and deploying cloud-native solutions using AWS services,...

  • Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India TerraGiG Full time

    Role: Data Engineer Experience: 4-9 years Location: Bangalore Mandatory Skills: Python, PySpark, AWS (must be working in the current project) Job Responsibilities: Extensive hands-on experience in application development using Python , PySpark , and other programming languages. Proficient in building and deploying cloud-native solutions using AWS...

  • Data Engineer

    3 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data EngineerLocation: Hyderabad, India - Hybrid Remote (3 days a week in office preferred)Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our organization....

  • Data Engineer

    3 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data Engineer Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our...

  • Senior Data Engineer

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...