Big Data Engineer

3 days ago

uttar pradesh, India Umanist Staffing Full time

Job Summary:We are hiring an experienced Big Data Engineer to design, build, and maintain high-performance data processing systems. The role requires strong expertise in Hadoop ecosystem, Spark, and cloud-based data pipelines with a focus on scalability, reliability, and performance.Key Responsibilities:Design and develop end-to-end big data pipelines for batch and real-time processing.Work with large datasets using Spark, Hadoop, Hive, HBase, and Kafka.Develop data ingestion, transformation, and storage layers.Optimize data workflows for speed, cost, and efficiency.Collaborate with analysts, data scientists, and application teams for data delivery.Ensure data security, lineage, and quality across the platform.Deploy and manage workloads on AWS, Azure, or GCP.Required Skills:Proficiency in Spark (PySpark/Scala), Hadoop, Hive, Kafka, HBase, and Sqoop.Strong programming skills in Python, Scala, or Java.Experience with ETL/ELT pipelines and data modeling.Good knowledge of cloud data platforms (AWS EMR, Dataproc, Databricks, Azure HDInsight).Familiar with data lake and data warehouse integration.Proficient in SQL and performance tuning.Knowledge of CI/CD, Docker, and Kubernetes preferred.Education:Bachelor's or Master's degree in Computer Science, Information Technology, or related field.Preferred:Cloud certifications (AWS Big Data, GCP Data Engineer, or Azure Data Engineer).Experience in streaming data pipelines using Kafka / Flink / Spark Streaming.Exposure to machine learning pipelines and data governance frameworks.

  • AI/ML Engineer

    2 weeks ago

    uttar pradesh, India BIG Language Solutions Full time

    AI/ML EngineerRole: AI/ML EngineerLocation: Noida(Work from Office)Team: AI & InnovationReports to: VP of Artificial IntelligenceYour RoleAt BIG Language Solutions, we're shaping the future of multilingual communication through cutting-edge AI. As an AI/ML Learning Engineer, you’ll be instrumental in designing, building, and scaling ML-driven capabilities...

  • Data Engineer

    2 weeks ago

    uttar pradesh, India CloudKeeper Full time

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...

  • Senior Big Data Engineer

    1 day ago

    madhya pradesh, India beBeeData Full time

    About UsWe develop solutions that empower those dedicated to keeping people, places, and communities safe.For over two decades, law enforcement and federal agencies across the globe have trusted us as their committed partner in safeguarding nations and enriching lives.Job SummaryDeploy and administer Hortonworks, Cloudera, Apache Hadoop/Spark...

  • Sr Associate Big Data Engineering

    4 weeks ago

    Hyderabad, Telangana - Andhra Pradesh, India AT&T Full time

    Key Responsibilities Data Engineering Architecture Design develop and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark Build and manage scalable data ingestion frameworks for batch and real-time data processing Implement and optimize data lake architecture in Azure Data Lake to support...

  • Telephony Engineer-Noida(Onsite Role)

    2 weeks ago

    uttar pradesh, India BIG Language Solutions Full time

    Job Title: Telephony Engineer-Noida(Onsite Role)Location: Noida(Work From Office)Department: IT Infrastructure / Operations SupportReports To: IT Manager / Infrastructure LeadEmployment Type: Full-timeShift: US ShiftJob Summary:The Telephony Engineer is responsible for the design, configuration, implementation, and maintenance of enterprise telephony systems...

  • Big Data Systems Administrator

    5 days ago

    madhya pradesh, India beBeeBigDataAdministrator Full time

    About the RoleWe are seeking a seasoned data professional to lead our big data initiatives. As a Hadoop Administrator, you will be responsible for designing, deploying and maintaining large-scale data processing systems.This is an exciting opportunity to work with cutting-edge technologies such as Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem. You...

  • Azure Data Engineer

    7 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Azure Data Engineer Location: Noida, Bangalore, Mumbai, Pune, Kolkata, Hyderabad Experience: 6 to 12yrs Must-Have** • Data Ingestion and Integration: Ingest data from various sources such as...

  • Scalable Data Architect

    7 days ago

    uttar pradesh, India beBeeData Full time

    Big Data EngineerWe are seeking an experienced Big Data Engineer to design and build scalable data pipelines using Azure Databricks, PySpark, and Python.Key Responsibilities:Data Pipeline Design and Development: Responsible for designing and building efficient data pipelines using Azure Databricks.Data Transformation: Experienced in transforming data using...

  • Motion Graphic Designer

    7 days ago

    uttar pradesh, India Big Oh Tech Full time

    Company Description Big Oh Tech is a globally recognized IT solutions leader specializing in software development, enterprise app development, staff augmentation, offshore outsourcing, and technical recruitment consulting. Backed by a team of over 100 technology enthusiasts, the company delivers scalable solutions to complex challenges, driving business...

  • Motion Graphic Designer

    5 days ago

    uttar pradesh, India Big Oh Tech Full time

    Company Description Big Oh Tech is a globally recognized IT solutions leader specializing in software development, enterprise app development, staff augmentation, offshore outsourcing, and technical recruitment consulting. Backed by a team of over 100 technology enthusiasts, the company delivers scalable solutions to complex challenges, driving business...