Big Data Engineer

4 weeks ago


Pune, Maharashtra, India HyrEzy Talent Solutions Full time

Role : Big Data Engineer

About Organization :

Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive data driven decision culture by analyzing vast amount of amount at scale.

Mentorship and enablement is the core culture of the organization, we believe in "The only way to do great work is to love what you do."

Role Description :

- Data modeling and architecture: You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.

- ETL and data integration: You would be responsible for building and maintaining data pipelines that move data from various sources into Azure, transform the data as necessary, and load it into Azure data stores.

- Data analysis and reporting: You would be responsible for designing and building data analysis and reporting solutions on Azure, using tools such as Azure Analysis Services, Power BI, and Excel.

- Performance tuning and optimization: You would be responsible for monitoring and tuning the performance of Azure data solutions, ensuring that they meet the required performance and scalability requirements.

- Security and compliance: You would be responsible for implementing security and compliance controls for Azure data solutions, including access controls, encryption, and data masking.

- Collaboration and communication: You would work closely with other members of the data engineering team, as well as with stakeholders in other departments, to ensure that Azure data solutions meet business requirements and are integrated into the wider technology landscape.

Required Qualifications :

- Degree in computer science, information technology, or a related field

- Experience with technologies such as Data Lake, SQL, PostgreSQL, Spark, and Azure Data Explorer

- Proficiency in programming languages such as Scala, Java or Python, and experience with distributed computing and database systems.

- Strong problem-solving and analytical skills, as well as excellent communication and collaboration skills, are also important for success in this role.

- Industry experience: 4 Years to 7 years

- Engineers needs to be self-motivated and objective driven.


- He/She should be ready to learn new domain and technology based on organization strategy.

Location : Pune

(ref:hirist.tech)
  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • AWS Data Engineer

    4 days ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : Only Immediate JoinerRole : AWS Data EngineerLocation : Pune, IndiaExperience : 8 YearsJD: Roles and responsibilities :- With over 8 yrs. of hands-on experience with Data Technologies - Requirement analysis and assess the technical feasibility of proposed solutions. - Act as the technical specialist in designing and recommending architecture for...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India Huquo Full time

    Job Description :Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...


  • Pune, Maharashtra, India Bask HR Consulting Pvt ltd Full time

    Job Description : - Build, design and, implement our highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in depth analytics.- Developing Big Data pipelines using modern technology stacks such as Spark, Hadoop, Kafka, HBase, Hive, and Presto.- Developing analytics applications using modern technology...


  • Pune, Maharashtra, India Enterprise Minds, Inc Full time

    Job Description :Mandatory Skills & Experience :- Strong GCP, Expertise in Apache Spark, Airflow, Python experience, SQL.- Good understanding of Hadoop eco-system and Hive.- Exceptional troubleshooting skills in the following: GCP, Spark, Big Query, Python, DataProc, CICD.- Construct and maintain ELT/ETL job processes sourcing from disparate systems...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the profiles....

  • AI/ML Engineer

    4 weeks ago


    Pune, Maharashtra, India ARR Recruitment Solutions Full time

    We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...

  • Technical Architect

    4 days ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Job Description :Mandatory Skills :- 7-15 years of total experience in software development - At least 4 years of experience with Big data technologies- Proficiency in at least one of the following programming languages : Python/Scala/Java- Experience of development and deployment of at least two end-to-end big data solutions- Understanding of RDBMS-...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years' experience in software development with Big data technologies- Proficiency in at least one of the following programming languages: Java/Scala/Python- Experience of development and deployment of at least one end-to-end data storage/processing pipeline- Basic understanding of RDBMS- Intermediate level expertise in Apache Spark,...

  • Lead Data Engineer

    4 weeks ago


    Mumbai/Pune/Maharashtra/Navi Mumbai, Maharashtra, India xl advisors Full time

    About us:JSW One Platforms is a venture founded by the world-renowned JSW group. JSW One is our integrated technology platform that seeks to transform India through increased transparency, trust, and ease-of-business. The JSW One Platforms are home to JSW One MSME and JSW One Homes. JSW One MSME, is a one-stop, multi-product digital marketplace, for MSMEs...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...


  • Pune, Maharashtra, India Zimetrics Technologies Private Limited Full time

    Experience :- 4+ years of data engineering or software engineering- 4+ years building data applications in Scala, Java, and Python- Proficient with distributed data processing with Apache Spark- Proficient with SQL and modern data warehouse platforms - Snowflake, Redshift, Big Query, or Synapse- Proficient with workflow management platforms - Airflow, AWS...

  • Data Engineer

    1 day ago


    Pune, Maharashtra, India EDGESOFT Full time

    Job Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...

  • Data Engineer

    1 day ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : immediate joinerRole : Data EngineerLocation : Onsite (Pune)Language : EnglishRoles and responsibilities :With over 3+ yrs. of hands-on experience with Data TechnologiesRequirement analysis and assess the technical feasibility of proposed solutions.Act as the technical specialist in designing and recommending architecture for application...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...


  • Pune, Maharashtra, India Coders Brain Technology & Private Limited Full time

    To be successful in this role, you should possess :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement...

  • Data Engineer

    5 days ago


    Pune, Maharashtra, India GetHyr Full time

    Responsibilities : - Create prototypes and proof-of-concepts for iterative development.- Experience with NoSQL databases, such as DynamoDB, MongoDB, etc.- Create and maintain optimal data pipeline architecture.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure...

  • Data Engineer

    1 week ago


    Pune, Maharashtra, India Nurturing Interns Private Limited Full time

    Role Summery:You will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data transformation, archiving, reporting and analytics solutions that meet the functional and non-functional requirements.- You will work closely with Project Managers to deliver the program.Dimension of...