Data Architectural Specialist

2 days ago

Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title

We are seeking a highly skilled Python Data Engineer to join our team in an on-premise data engineering environment. The ideal candidate will have experience in ETL tools, data processing technologies, data orchestration, and relational databases.

The successful candidate should be proficient in Python scripting for data engineering tasks and have experience working with Spark, PySpark, and other relevant data technologies.

This is an excellent opportunity to work on exciting projects that require developing scalable data pipelines, real-time data streaming, and optimizing data processing tasks using Python.

Key Responsibilities:
  • Design, develop, and optimize ETL pipelines using open-source or cloud ETL tools (e.g., Apache Nifi, Talend, Pentaho, Airflow, AWS Glue).
  • Write Python scripts to automate data extraction, transformation, and loading (ETL) processes.
  • Work with Apache Spark and PySpark to process large datasets in a distributed computing environment.
  • Use Apache Airflow or other orchestration tools to schedule, monitor, and automate data pipeline workflows.
  • Design and implement real-time data streaming solutions using technologies like Apache Kafka or AWS Kinesis.
  • Work with open-source table formats like Apache Parquet, Apache Avro, or Delta Lake.
  • Work with relational databases (e.g., PostgreSQL, MySQL, SQL Server) for data storage, management, and optimization.
Requirements:
  • Experience working with open-source ETL tools such as Apache Nifi, Talend, or Pentaho.
  • Proficiency in Python for automating data processing tasks and working with libraries such as Pandas, Dask, PySpark.
  • Experience with Apache Spark and PySpark for distributed data processing.
  • Experience using Apache Airflow or similar tools for scheduling and automating data pipelines.
  • Strong experience with at least one relational database and a solid understanding of database concepts.

  • Security and Data Architecture Specialist

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataProtection Full time ₹ 1,80,00,000 - ₹ 2,25,00,000

    Security and Data Architecture ExpertWe are seeking a seasoned expert in security and data architecture to join our team. The ideal candidate will possess a deep understanding of payment security and data architecture risks, as well as experience in designing and implementing efficient data storage solutions.This critical role involves providing independent...

  • Architectural Visualization Specialist

    4 days ago

    Tiruppur, Tamil Nadu, India beBeeArchitecturalVisualization Full time ₹ 5,00,000 - ₹ 10,00,000

    Architectural Visualization SpecialistThe role of an Architectural Visualization Specialist is to create high-quality visual content that brings architectural concepts to life.Key Responsibilities include:• Produce photorealistic interior/exterior renders• Develop walkthroughs, 360° visuals, and presentation material• Work closely with architects to...

  • Data Architecture Specialist

    18 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 16,00,000

    About Us:We are a global IT services company headquartered in the United States.Founded in 1996, we specialize in digital engineering and IT services to help clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation.We partner with major firms in various industries.Job Title: Data EngineerKey...

  • Architectural Visualization Specialist

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeVisualization Full time ₹ 20,00,000 - ₹ 40,00,000

    Job Overview:We are seeking an experienced Architectural Visualization Specialist to create high-quality, photorealistic architectural walkthroughs and immersive visual experiences.This role requires expertise in 3D visualization, animation, and real-time rendering to bring architectural designs to life.Key Responsibilities:Develop high-quality, detailed...

  • Data Architectural Specialist

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleSenior Data EngineerMain Responsibilities:Data Pipeline Development:Design and develop scalable data pipelines using Python and GCP services such as Vertex AI, BigQuery, and Dataflow.Ensure high-throughput and low-latency processing of massive datasets efficiently.Data Filtering and Curation:Optimize data ingestion and transformation for downstream...

  • Data Architecture Expert

    1 day ago

    Tiruppur, Tamil Nadu, India beBeeArchitecture Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a Data Architecture Expert to lead our data engineering projects.This role involves designing and developing data engineering solutions, partnering with stakeholders to stay focused on common goals. Responsibilities include:Leading large-scale data engineering and warehousing projectsBuilding custom integrations between...

  • Cloud Architecture Specialist

    1 week ago

    Tiruppur, Tamil Nadu, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Architect SpecialistThis is a full-time hybrid role for an expert Cloud Architect who will be responsible for designing, deploying and managing cloud-based infrastructure. The ideal candidate will have in-depth knowledge of cloud computing and virtualization platforms.Key ResponsibilitiesDesigning and implementing scalable cloud architecture...

  • Optimizing Big Data Architectures

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have 3+ years of experience in designing and implementing optimal data pipeline architectures, with expertise in big data tools, relational SQL, and NoSQL databases.Key ResponsibilitiesCreate and maintain optimal data pipeline architecture using big data...

  • Building Strategic Data Architectures

    1 week ago

    Tiruppur, Tamil Nadu, India beBeeDataStrategist Full time ₹ 36,00,000 - ₹ 45,00,000

    Job Title: Data ArchitectThis is an exceptional opportunity to shape the company's data strategy and architecture.Key Responsibilities:Design and implement end-to-end data pipelines and integration solutions for various structured and unstructured data sources and targets.Architect and design scalable data warehouse solutions on cloud platforms like Big...

  • Data Architecture Specialist

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead ETL/Big Data Tester Position OverviewThe primary responsibility of the Lead ETL/Big Data Tester will be to ensure the high-quality delivery of our products by testing artificial intelligence and machine learning-based lawful interception and communication analytics solutions.This individual will work closely with the development team to identify and...