Data Engineer
5 days ago
We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and decision-making. If you are passionate about building robust data infrastructure and enjoy working in a fast-paced environment, this role is for you
Key Responsibilities :
1. Design & Develop Scalable Data Pipelines: Architect and build efficient data ingestion pipelines that empower the business with timely and actionable insights to drive strategy and operations.
2. Collaborate with Cross-Functional Teams: Work closely with technical and business teams to gather requirements and translate them into technical specifications and solutions.
3. Optimize Data Architecture: Continuously refine and improve the performance, reliability, and scalability of data pipelines to ensure seamless integration of data across systems.
4. Ensure Data Integrity: Perform rigorous data quality checks and uphold best practices to maintain the accuracy, consistency, and integrity of data.
5. Build ETL Solutions: Develop ETL frameworks to collect, transform, and integrate data from diverse sources such as Kafka, Scylla, PostgreSQL, MongoDB, APIs, and various file formats.
6. Adopt Best Practices: Implement best-in-class engineering practices around reporting and analysis, ensuring data integrity, testing, validation, and comprehensive documentation.
Basic Qualifications :
1. Bachelor’s degree in Computer Science, Information Systems, or a related technical field, or equivalent work experience.
2. 3+ years of hands-on experience with cloud-based data technologies, including message queues, event grids, relational databases, NoSQL databases, data warehouses, and big data technologies (e.g., Spark).
3. Proficiency in Spark (Java, Python, SQL): Expertise in developing and optimizing Spark-based applications for large-scale data processing.
4. Advanced SQL Skills: Ability to create complex queries, manage database structures, and ensure optimal performance.
5. Experience with Docker and Kubernetes: Familiarity with deploying applications using modern containerisation and orchestration tools.
6. DevOps and CI/CD: Solid understanding of modern DevOps practices, including Git, continuous integration, and continuous deployment pipelines.
7. Agile Development Experience: Comfortable working in an Agile environment, particularly using Scrum methodology.
Preferred Qualifications
1. API Frameworks & OOP: Experience with API frameworks and object-oriented programming to integrate services and improve data workflows.
2. Business Acumen: Ability to collaborate closely with leadership to deliver innovative solutions tailored to evolving business needs.
3. Strong Communication Skills: Excellent verbal and written communication abilities, with a knack for explaining complex technical concepts to both technical and non-technical stakeholders.
4. Ability to leverage tools like langchain, llama index ..etc to build llm based applications.
-
Data Engineer
4 weeks ago
Bangalore Metropolitan Area, India Airties Full timeAbout AirtiesAirties is a leading provider of advanced Wi-Fi solutions and services to broadband operators. Our mission is to empower operators to deliver a better-connected home experience for their subscribers.We offer a range of innovative solutions, including Smart Wi-Fi software, a cloud-based experience management platform, and expert engineering and...
-
Data Engineer
1 week ago
Bangalore Metropolitan Area, India Kratos Gamer Network Full timeAbout KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...
-
Data Engineer
4 weeks ago
Bangalore Metropolitan Area, India Sigmoid Full timeAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Sigmoid. The ideal candidate will have a strong background in big data technologies, particularly Java, Apache Spark, and SQL.Key Responsibilities:Design and implement scalable data pipelines using Apache Spark.Work with cross-functional teams to design and implement efficient...
-
Data Engineer
1 month ago
Bangalore Metropolitan Area, India Tata Consultancy Services Full timeGreetings from TCS!Job Title: Data EngineerRequired Skillset: R DeveloperLocation: Hyderabad ,Kolkata, Noida, Chennai, BangaloreExperience Range: 4-8yearsJob DescriptionMust-Have**Expert R programming skills – experienced in working on packages like tidyverse, dplyr, ggplot2, purrr, tidy, data.table, plotly etc. R Package development (including testing and...
-
Azure Data Engineer
2 weeks ago
Bangalore Metropolitan Area, India TEKsystems Full timeTEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...
-
Azure Data Engineer
3 weeks ago
Bangalore Metropolitan Area, India TEKsystems Full timeTEKsystems is looking for enthusiasts Azure Data Engineer coming from a hardcore Python background. We are seeking a detail-oriented Azure Data Engineer with strong Python programming skills and working knowledge of PySpark to join our team. You will play a key role in ensuring data integrity and accuracy while utilizing Excel and PowerPoint for report...
-
Senior Data Engineer
1 week ago
Bangalore Metropolitan Area, India CodeVyasa Full timeLooking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...
-
GCP Data Engineer
6 days ago
Bangalore Metropolitan Area, India Tech Mahindra Full timeResponsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...
-
Snowflake Data Engineer
4 weeks ago
Bangalore Metropolitan Area, India CodeVyasa Full timeJob Title: Snowflake DeveloperWe are seeking a highly skilled Snowflake Developer with strong Python expertise and experience in orchestrating Snowflake tasks and migrating from SAS to Snowflake. The ideal candidate will have over 7 years of experience in data engineering and development, with at least 5 years focused on Snowflake and Python.Key...
-
Senior Snowflake Data Engineer
1 day ago
Bangalore Metropolitan Area, India CodeVyasa Full timeRole SummaryCodeVyasa is seeking a seasoned Snowflake Data Engineer with expertise in Python to lead the migration of complex SAS processes to Snowflake. The successful candidate will have a strong background in data engineering, data warehousing, and cloud-based solutions.Key Responsibilities:Design, build, and manage end-to-end data pipelines using...
-
Data Platform Engineer
11 hours ago
Bangalore Metropolitan Area, India NXP Semiconductors Full timeAs a Graph Engineer, you will:Develop pipelines and code to support the ingress and egress of this data to and from the knowledge graphs. Perform basic and advanced graph querying and data modeling on the knowledge graphs that lie at the heart of the organization's Product Creation ecosystem. Maintain the (ETL) pipelines, code and Knowledge Graph to stay...
-
Azure Data Engineer
3 weeks ago
Bangalore Metropolitan Area, India Quantzig Full timeCompany: Quantzig AnalyticsLocation: Kadubeesanahalli, Bangalore.Experience : 6+ years minimum is requiredNotice: preferably 0 to 30daysJob Description:Seeking a self-driven professional with a strong ownership mentality and the ability to work independently without constant guidance. The ideal candidate will have an agile mindset, capable of swiftly...
-
Senior Data Engineering Specialist
2 days ago
Bangalore Metropolitan Area, India CodeVyasa Full timeAt CodeVyasa, we're on a mission to revolutionize data processing with our team of rockstar developers. As a Senior Data Engineer, you'll play a crucial role in designing and implementing cutting-edge data pipelines using PySpark for both streaming and batch processing.We're looking for an experienced professional with a minimum of 7+ years of experience in...
-
Senior Data Engineer
3 weeks ago
Bangalore Metropolitan Area, India Snaphunt Full timeThe OpportunityWe're seeking a highly skilled Senior Data Engineer - Machine Learning to join our team at Snaphunt. As a key member of our engineering team, you'll be responsible for designing, developing, and deploying scalable data pipelines and machine learning models.The RoleArchitect and implement end-to-end data pipelines using Python and relevant...
-
Data Platform Engineer
4 weeks ago
Bangalore Metropolitan Area, India ApTask Full timePrimary responsibilities:Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data PlatformLead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technologyLead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in...
-
Data Scientist
1 week ago
Bangalore Metropolitan Area, India Safran Engineering Services Full timeExperience :3year to 8yearsWe are looking for an experienced Data Scientist with expertise in Generative AI and Large Language Models (LLMs) to join our innovation team.•In this role, you will work at the cutting edge of AI technologies, leveraging LLMs to develop intelligent applications that can generate, analyze, and process text data.•You will...
-
Senior MLOps Engineer
2 weeks ago
Bangalore Metropolitan Area, India Snaphunt Full timeThe OpportunityWe are seeking a highly skilled Senior MLOps Engineer to join our team at Snaphunt. As a key member of our AgriTech startup, you will play a pivotal role in shaping our high-impact product driving the future of Agriculture.Key ResponsibilitiesDesign and implement automated ML pipelines for developing, testing, deploying, and monitoring ML...
-
Senior Data Scientist
3 weeks ago
Bangalore Metropolitan Area, India Snaphunt Full timeThe OpportunityWe are seeking a highly skilled Senior Data Scientist to join our team at Snaphunt. As a key member of our remote sensing team, you will play a crucial role in developing and implementing data-driven solutions for our satellite data analysis projects.Key Responsibilities:Develop and implement advanced machine learning models and algorithms for...
-
Senior MLOps Engineer
4 days ago
Bangalore Metropolitan Area, India a Snaphyre Client Full timeWe are seeking a highly skilled Senior MLOps Engineer to join our team at a Snaphyre Client, a pioneering AgriTech startup. Our mission is to create value by visualizing agricultural land, enabling sustainable farming practices, reducing carbon emissions, and driving positive change for farmers, the planet, and future generations.The RoleAs a key member of...
-
Data QA Engineer
1 week ago
Bangalore Metropolitan Area, India Luxoft Full timeLocationsBengaluru, Chennai, PuneProject descriptionWorking within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.ResponsibilitiesAnalyse and document test data , results, and recommendations.Perform functional and...