Big Data Engineer

4 days ago

Bengaluru, India Hexaware Technologies Full time

Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various enterprise architects, Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective. •Translate business requirements into technology solutions. •Lead designing of all aspects of our data solution including artifact creation such as diagrams, playbooks, and other technical documents Skills: •Over all 5 to 8 years of experience with Data Management & Big Data and Analytics. •At least 2 to 3 years of experience in implementing the data solutions on MS Azure using Azure Data Factory. •Must have strong SQL background and ability to tune the SQL for optimized ETL jobs. •one to two years of experience in Azure Synapse Analytics is plus. •Extensive hands-on experience in data warehousing design, tuning and ETL/ELT process development by using cloud native technologies. •Apache Spark experience using Scala or PySpark or pre-packaged tools like Databrick is plus. •At least one year of experience with API based/real time integrations using Kafka or similar technologies. •At least 1 to 2 years of experience with big data using spark and java for data processing. •Developing the CICD pipeline for Azure Infrastructure, version control strategy and Integrate source control (git, GitHub, azure repos). •At least one year experience with unified data governance solution using MS Purview.  •In-depth understanding of various storage services offered by Azure. •Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments. •Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines. •Certification in Azure fundamentals (AZ-900) and Azure data engineering (DP-203) is must. •Strong client-facing communication and facilitation skills.

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Acme Services Full time

    Job Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Whatjobs IN C2 Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...

  • Big Data

    4 weeks ago

    Bengaluru, India Teamware Solutions Full time

    Job Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Akshya Patra Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Big Data Engineer with expertise in various Big Data tools and ecosystems. The ideal candidate should have hands-on experience with technologies such as Hadoop, Spark, Hive, and Impala. A strong proficiency in programming languages like Scala, Java, and Python is essential for designing and implementing data processing...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Bengaluru, India Fusion Plus Solutions Full time

    Job Description We are looking for a skilled Big Data Engineer with 5 to 7 years of hands-on experience in Big Data technologies. The ideal candidate should have strong expertise in Hadoop, HDFS, Hive, SQL, and Unix, and be able to work on large-scale data processing systems. Roles and Responsibilities: - Work on design, development, and optimization of Big...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...