Senior Data Engineer

4 weeks ago


BangaloreKolkataPune, IN Nilasu consulting Full time

Summary :

- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.

- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.

- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.

Responsibilities :

- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.

- Optimize Spark jobs for performance and scalability to handle large datasets.

- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).

- Manage and maintain data pipelines on Hadoop infrastructure.

- Develop and integrate RESTful APIs for data access and consumption.

- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).

- Troubleshoot and fix performance issues across the codebase and database queries.

- Document data pipelines and processes for maintainability and knowledge sharing.

- Stay up-to-date with the latest advancements in big data technologies and tools.

Qualifications :

- At least 6 years of experience as a Data Engineer or a related role.

- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.

- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).

- Experience with Linux environments and Hadoop infrastructure.

- Experience working with RESTful APIs for data exchange.

- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.

- Understanding of Agile development methodologies and practices.

- Excellent problem-solving and analytical skills.

- Strong written and verbal communication skills to collaborate effectively with stakeholders.

- Passion for learning and implementing new technologies.

- Ability to thrive in a fast-paced and dynamic environment.

(ref:hirist.tech)

  • Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • AWS Data Engineer

    4 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...


  • Hyderabad/Pune, IN AMAZATIC SOLUTIONS LLP Full time

    Senior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong understanding...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Senior Data Engineer

    23 hours ago


    Pune/Mysore, IN IT Full time

    We are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library. The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions. Additionally, experience with Azure...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...


  • Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    Job Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • BI Tableau Engineer

    4 weeks ago


    Bangalore/Hyderabad/Delhi/Kolkata, IN Freelance Full time

    Job DescriptionSenior resource with minimum 2-8 Years of experience in Tableau.- Very strong experience on Tableau Functions, Tableau Data Prep and Tableau Visuals.- Good experience on end-to-end Enterprise BI development & deployment.- Developing data Models, Data Preparation with Data Flows and designing BI reports- Proven experience in writing advanced...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description: As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.- Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...


  • Pune/Bangalore, IN Hiret Full time

    Job Description :- Develop high performance cloud native Java microservices.- Mentor/guide junior developers in completing their stories.- Working closely with Business Analysts, end users and architects to build flexible enterprise software.Role : Senior Software engineer - JavaJob location : Pune & Bangalore- We are reimagining products and redesigning...

  • Publicis Sapient

    2 days ago


    Delhi NCR/Gurgaon/Gurugram/Noida/Bangalore, IN Publicis Sapient Full time

    Job Description :Role : Senior Associate Data Engineering Level 2In the role of Senior Associate L2 in Data Engineering, you'll be instrumental in translating client requirements into technical designs and implementing components for data engineering solutions. Your impact spans across data ingestion, integration, transformation, storage, computation...


  • Bangalore/Any Location, IN TalentXo Full time

    Criteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling- Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Chennai/Madurai, IN Resourcetree Full time

    Job Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...


  • Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Senior Data Engineer

    4 weeks ago


    Pune/Chandigarh/Mohali, IN Tekfortune IT India Pvt. Ltd. Full time

    Role/Title : Senior Data EngineerExperience : 6-10 Years' experienceLocation : PuneNotice period : 0-30days onlyKey Skills : SSIS, SQL, Azure SynapseJob Summary :As a Senior Data Engineer, you will support the European Market using the Windows & Azure suite of Analytics & Data platforms. The focus of the role is on the technical aspects and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...