Senior Data Engineer
4 weeks ago
Summary :
- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.
- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.
- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.
Responsibilities :
- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.
- Optimize Spark jobs for performance and scalability to handle large datasets.
- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).
- Manage and maintain data pipelines on Hadoop infrastructure.
- Develop and integrate RESTful APIs for data access and consumption.
- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).
- Troubleshoot and fix performance issues across the codebase and database queries.
- Document data pipelines and processes for maintainability and knowledge sharing.
- Stay up-to-date with the latest advancements in big data technologies and tools.
Qualifications :
- At least 6 years of experience as a Data Engineer or a related role.
- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.
- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).
- Experience with Linux environments and Hadoop infrastructure.
- Experience working with RESTful APIs for data exchange.
- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
- Understanding of Agile development methodologies and practices.
- Excellent problem-solving and analytical skills.
- Strong written and verbal communication skills to collaborate effectively with stakeholders.
- Passion for learning and implementing new technologies.
- Ability to thrive in a fast-paced and dynamic environment.
-
Senior Big Data Engineer
4 weeks ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
AWS Data Engineer
4 days ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
AMAZATIC - Data Engineer/Senior Engineer - Azure
4 weeks ago
Hyderabad/Pune, IN AMAZATIC SOLUTIONS LLP Full timeSenior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong understanding...
-
Senior Data Engineer
4 weeks ago
Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full timeSenior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...
-
Senior Data Engineer
23 hours ago
Pune/Mysore, IN IT Full timeWe are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...
-
Senior Data Engineer
4 weeks ago
Bangalore/Remote, IN Geektrust.in Full timeRole : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...
-
Senior Data Engineer
4 weeks ago
Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...
-
Harmony Data Integration Technologies
4 days ago
Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...
-
Senior Data Engineer
3 weeks ago
Bangalore/Any Location, IN Randstad Full timeJob Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...
-
BI Tableau Engineer
4 weeks ago
Bangalore/Hyderabad/Delhi/Kolkata, IN Freelance Full timeJob DescriptionSenior resource with minimum 2-8 Years of experience in Tableau.- Very strong experience on Tableau Functions, Tableau Data Prep and Tableau Visuals.- Good experience on end-to-end Enterprise BI development & deployment.- Developing data Models, Data Preparation with Data Flows and designing BI reports- Proven experience in writing advanced...
-
Senior Data Engineer
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full timeJob Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...
-
Senior Data Engineer
4 weeks ago
Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
Senior Software Engineer
4 weeks ago
Pune/Bangalore, IN Hiret Full timeJob Description :- Develop high performance cloud native Java microservices.- Mentor/guide junior developers in completing their stories.- Working closely with Business Analysts, end users and architects to build flexible enterprise software.Role : Senior Software engineer - JavaJob location : Pune & Bangalore- We are reimagining products and redesigning...
-
Publicis Sapient
2 days ago
Delhi NCR/Gurgaon/Gurugram/Noida/Bangalore, IN Publicis Sapient Full timeJob Description :Role : Senior Associate Data Engineering Level 2In the role of Senior Associate L2 in Data Engineering, you'll be instrumental in translating client requirements into technical designs and implementing components for data engineering solutions. Your impact spans across data ingestion, integration, transformation, storage, computation...
-
Senior Data Warehouse Engineer
2 weeks ago
Bangalore/Any Location, IN TalentXo Full timeCriteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling- Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...
-
Senior Data Engineer
4 weeks ago
Bangalore/Chennai/Madurai, IN Resourcetree Full timeJob Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...
-
Senior Data Engineer- Spark/Python
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full timeWe are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...
-
Senior Data Engineer
4 weeks ago
Pune/Chandigarh/Mohali, IN Tekfortune IT India Pvt. Ltd. Full timeRole/Title : Senior Data EngineerExperience : 6-10 Years' experienceLocation : PuneNotice period : 0-30days onlyKey Skills : SSIS, SQL, Azure SynapseJob Summary :As a Senior Data Engineer, you will support the European Market using the Windows & Azure suite of Analytics & Data platforms. The focus of the role is on the technical aspects and...
-
Senior Data Engineer
4 weeks ago
Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...
-
Senior Cloud Data Engineer
4 weeks ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...