Data Engineer

16 hours ago

Visakhapatnam, India GreatHR Solutions Full time

Position: Data EngineerRelevant years of Experience: 4+ yearsJob Type: ContractWork Location: Remote (India)Salary Range: 8L PASkills Required: Spark or Pyspark, SQL, Python, - Must have Databricks, Cloud servies (Azure/ GCP/ AWS), -Good to have Azure/AWS/GCP, Databricks Certified - Good to haveHadoop, Hive, Sqoop- Can have - not compulsoryFundamentals of Cloud Computing: Understanding of cloud concepts like IaaS, PaaS, SaaS, and Azure architecture. SQL & Database Administration: Proficiency in SQL (T-SQL) for querying, managing, and troubleshooting Azure SQL databases. Basic understanding of database design and normalization.Data Warehousing & ETL: Conceptual knowledge of data warehousing principles, data transformation, and ETL processes.Azure Data Services: Experience/ Familiarity with Azure Data Lake Store, and Azure Analysis Services.Azure Data Factory: Expertise in ETL pipeline creation and data integration from various sources.Azure Synapse Analytics: Skills in big data processing, SQL performance tuning, and data visualization.Azure Databricks: Proficiency in Spark-based data engineering, machine learning model deployment, and real-time analytics.Data Visualization & Reporting: Basic understanding of Power BI and the ability to create simple reports and dashboards.Troubleshooting & Issue Resolution: Ability to diagnose and troubleshoot basic issues related to Azure data services and resolve them with guidance.Monitoring & Logging: Basic understanding of Azure monitoring tools and logs for identifying and resolving issues.Power BI: Competency in dashboard creation, data modeling, and interactive reporting for business insights.

  • Data engineer

    1 week ago

    Visakhapatnam, India Staffingine LLC Full time

    Data Engineer India, Remote Full Time /Contract # of Positions - 3 Job Summary The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as...

  • Data Engineer

    3 weeks ago

    Visakhapatnam, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    3 weeks ago

    Visakhapatnam, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    7 days ago

    visakhapatnam, India beBeeDataEngineer Full time

    Job TitleData Engineering Role:Databricks & Unity Catalog experience.Deep knowledge of Unity Catalog — creating and managing catalogs, schemas, and tables.Automating data onboarding and metadata registration via Unity Catalog APIs or Databricks CLI.Understanding of lineage, ownership, data access policies, and Delta Sharing.Automation, CI/CD & GitHub...

  • Data Sustainability Engineer

    6 days ago

    visakhapatnam, India beBeeSustainability Full time

    Job Title: Sustainability Data Engineering LeadAbout the Role:The role of the Sustainability Data Engineering Lead is to create data pipelines and models that combine engineering, manufacturing, and supplier data. This position will be responsible for developing ETL/ELT pipelines on Databricks using PySpark and SQL to support carbon footprint analytics.Key...

  • Data Engineer

    6 days ago

    visakhapatnam, India beBeeData Full time

    Job TitleJob Summary:Design and implement cutting-edge data solutions, leveraging software and data to drive business outcomes.Collaborate with stakeholders to develop architecture and design artifacts for complex applications.Lead evaluation sessions to assess technical credentials and architectural designs.Implement robust monitoring and alerting systems...

  • Cloud Data Engineer

    3 days ago

    visakhapatnam, India beBeeDataEngineer Full time

    Job Title: Cloud Data EngineerCompany Direct Client is looking for a highly skilled data engineer to lead cloud-based projects. This role involves designing, implementing, and maintaining large-scale data processing systems using Python, AWS, and SQL.Responsibilities:Design and implement cloud-based data pipelines utilizing various technologies such as...

  • Data Engineering Leader

    7 days ago

    visakhapatnam, India beBeeDataEngineering Full time

    Data Engineering LeadershipJob Description:We are seeking an experienced data engineering leader to oversee the development and implementation of scalable data pipelines, focusing on web crawling technology.The ideal candidate will design, implement, and optimize robust crawling systems using modern frameworks and establish pipeline orchestration using...

  • Big Data Engineer

    6 days ago

    visakhapatnam, India beBeeData Full time

    Cloud Data Engineer PositionThe role of Cloud Data Engineer is to design, develop and optimize scalable cloud-based data solutions. This position involves strong Python programming skills, expertise in ETL/ELT processes and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis and DynamoDB.The ideal candidate will excel...

  • Data Engineering Specialist

    6 days ago

    visakhapatnam, India beBeeData Full time

    Senior Data ArchitectThe Opportunity:We are seeking a highly experienced Senior Data Architect to play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and...