Data Engineer

1 month ago

Lagos, Lagos, Nigeria Interswitch Full time

Job Description: Develop and implement data integration solutions using Spark and ETL tools to provide ready-to-use datasets to data scientists and analysts.

**Job Title:** Data Engineer

**Company:** [Company Name]

**Job Summary:** Develop and implement data integration solutions using Spark and ETL tools to provide ready-to-use datasets to data scientists and analysts.

**Responsibilities:**

  • Data Ingestion and Extraction:
    • Develop and implement efficient data ingestion pipelines to acquire and extract large volumes of structured and unstructured data.
    • Ensure data integrity and quality during the ingestion process.
    • Integrate various data sources and formats into a unified data ecosystem.
  • Data Processing and Transformation:
    • Design and execute data processing workflows to clean, transform, and enrich raw data.
    • Develop scalable data processing algorithms and techniques to handle big data volumes efficiently.
    • Optimize data processing pipelines for performance and reliability.
  • Data Storage and Management:
    • Create and maintain data storage architectures that cater to the specific needs of big data applications.
    • Implement robust data management strategies, including data partitioning, indexing, and compression techniques.
    • Ensure data security, privacy, and compliance with relevant regulations.
  • Data Analysis and Modeling:
    • Collaborate with data scientists and analysts to understand their requirements and translate them into scalable data models.
    • Apply data visualization techniques to communicate insights effectively.
  • Performance Optimization:
    • Identify and implement strategies to enhance the performance and efficiency of big data applications and systems.
    • Conduct performance tuning, load testing, and capacity planning to meet scalability and throughput requirements.
    • Monitor system performance and troubleshoot issues related to data processing, storage, and retrieval.
  • Data Governance and Compliance:
    • Establish and enforce data governance policies, standards, and best practices.
    • Ensure compliance with data regulations, such as GDPR or HIPAA, by implementing appropriate data protection measures.
    • Conduct data audits and implement data quality controls to maintain data accuracy and consistency.
  • Collaboration and Communication:
    • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand their data requirements and provide technical support.
    • Communicate complex technical concepts and findings to non-technical stakeholders clearly and concisely.
    • Participate in knowledge-sharing activities and contribute to the continuous improvement of data engineering practices.
  • Documentation and Knowledge Sharing:
    • Document data engineering processes, workflows, and system architectures for future reference and knowledge transfer.
    • Prepare technical documentation, including data dictionaries, data lineage, and system specifications.
    • Create and maintain documentation related to data governance, compliance, and security protocols.

**Education and Certifications:**

  • BSc in Computer Science/Engineering or related field.
  • Strong industry/sector participation and relevant professional certifications, such as:
    • Azure Data Engineer Associate
    • Databricks Certified Data Engineer Associate
    • Databricks Certified Data Engineer Professional
    • Amazon Web Services AWS Certified Data Analytics – Specialty
    • Cloudera Data Platform Generalist Certification
    • Data Science Council of America DASCA Associate Big Data Engineer
    • Data Science Council of America DASCA Senior Big Data Engineer
    • Google Professional Data Engineer
    • IBM Certified Solution Architect – Cloud Pak for Data v4.x
    • IBM Certified Solution Architect – Data Warehouse V1

**Experience:**

  • At least 3 years developing, deploying, and managing robust ETL/ELT data solutions, preferably in a reputable Financial Institution or FinTech company.

  • Data Engineer

    4 weeks ago

    Lagos, Lagos, Nigeria Interswitch Full time

    Job Description for Data EngineerDevelop reliable data integration solutions using Spark and ETL tools to provide ready-to-use datasets to data scientists and analysts.Key Responsibilities:Design and implement efficient data ingestion pipelines to acquire and extract large volumes of structured and unstructured data.Clean, transform, and enrich raw data...

  • Data Engineer Position

    2 weeks ago

    Lagos, Lagos, Nigeria INFINION TECHNOLOGIES LIMITED Full time

    Data Engineer Role at INFINION TECHNOLOGIES LIMITEDWe are seeking a highly skilled Data Engineer to join our team at INFINION TECHNOLOGIES LIMITED. As a Data Engineer, you will be responsible for designing, developing, and optimizing batch and stream data pipelines, data platforms, and administration.Key Responsibilities:Design effective data pipelines and...

  • Data Engineer Leader

    7 days ago

    Lagos, Lagos, Nigeria INFINION TECHNOLOGIES LIMITED Full time

    Company OverviewINFINION TECHNOLOGIES LIMITED is a dynamic and innovative tech company dedicated to delivering cutting-edge solutions across various sectors. With an expanding footprint in the African market, we are seeking a motivated detail-oriented, dedicated, and knowledgeable Data Engineer to join our team.About the JobWe offer a competitive salary of...

  • Data Solutions Architect

    4 days ago

    Lagos, Lagos, Nigeria INFINION TECHNOLOGIES LIMITED Full time

    About UsInfinion Technologies Limited is a cutting-edge tech company dedicated to delivering innovative solutions across various sectors. We are expanding our presence in the African market and seeking a motivated detail-oriented, dedicated, and knowledgeable Data Solutions Architect to join our team.Company OverviewWe are a dynamic and innovative tech...

  • Field Engineer

    1 month ago

    Lagos, Lagos, Nigeria Deepwater Engineering Limited DEL Full time

    Seeking an experienced engineer with strong project management and operational efficiency skills to join our team. Key Responsibilities: Manage projects and improve operational efficiency. Collaborate with team members to enhance organizational productivity. Develop a deep understanding of the oil and gas industry. Solve...

  • Process Engineer

    1 month ago

    Lagos, Lagos, Nigeria Lafarge Cement Full time

    Process Engineer Summary: Lead plant discussions to improve throughput, efficiency, quality, and environmental performance, diagnosing issues and developing solutions through data analysis and field measurements. The Process Engineer plays a key role in driving plant performance by leading discussions and investigations to improve throughput, efficiency,...

  • Data Centre and Facilities Operations Manager

    3 weeks ago

    Lagos, Lagos, Nigeria Sigma Consulting Group Full time

    Job Title: Team Lead, FacilitiesFunction: Overseeing Data Centre and Facilities OperationsReporting to: Head Tx/Core & FacilitiesKey Responsibilities:• Ensure effective management of all data center operations, adhering to Service Level Agreements (SLAs) and Key Performance Indicators (KPIs).• Negotiate with service providers to deliver efficiencies and...

  • Ubuntu Engineering Delivery and Excellence Manager

    4 weeks ago

    Lagos, Lagos, Nigeria Canonical Full time

    We are seeking a Quality Engineering Manager to lead our Ubuntu Quality Engineering team in taking Linux distro quality to a new level through automation and large-scale data analysis. The role involves defining and monitoring quality metrics for the most popular Linux distro, setting and managing expectations with other engineering teams, and advocating...

  • Project Quality Engineer

    4 weeks ago

    Lagos, Lagos, Nigeria Karbak Ventures Limited Full time

    We are looking to hire an experienced Project Quality Engineer / Supervisor to oversee all aspects of quality management for our projects. The project quality coordinators will be engaged in inspecting materials, processes, and products, ensuring compliance with new and existing quality standards and regulations, implementing quality management actions, and...

  • Design and Control Engineer

    4 weeks ago

    Lagos, Lagos, Nigeria Value Edge Management Service Limited Full time

    Electrical and Instrumentation Design Specialist needed to work on refinery projects, designing and drafting assignments, gathering data, and creating documentation. Bachelor's degree in Electrical Engineering or related field required, with extensive experience in Electrical & Instrumentation Design and knowledge of applicable codes and standards. Excellent...

  • Data Centre Operations Manager

    3 weeks ago

    Lagos, Lagos, Nigeria Sigma Consulting Group Full time

    Job Title: Team Lead, FacilitiesFunction: Overseeing Data Centre and Facilities OperationsReporting to: Head Tx/Core & FacilitiesTravel Frequency: OccasionalWork Schedule: 8:00 AM - 5:00 PMDivision: InfrastructureDepartment: FacilitiesJob Grade: PermanentLocation: LagosSalary: 6-8 Million AnnuallyPurpose of the Job:The Team Lead, Facilities is responsible...

  • Data Centre and Facilities Operations Manager

    4 weeks ago

    Lagos, Lagos, Nigeria Sigma Consulting Group Full time

    {"title": "Data Centre and Facilities Operations Manager", "content": "Data Centre and Facilities Operations ManagerAt Sigma Consulting Group, we are seeking a highly skilled Data Centre and Facilities Operations Manager to join our team. As a key member of our infrastructure team, you will be responsible for the management and maintenance of our asset...

  • Backend Software Engineer

    2 weeks ago

    Lagos, Lagos, Nigeria PST Full time

    We are looking for a highly skilled Backend Software Engineer to join our team at PST. The ideal candidate will have expertise in Java and experience with Spring Boot. As a Backend Software Engineer, you will be responsible for building sophisticated web applications that meet the needs of our users.Key Responsibilities:Write effective, scalable code that...

  • Electrical or Mechanical Engineer

    4 weeks ago

    Lagos, Lagos, Nigeria Imagelinks West Africa Ltd Full time

    Job Title: Electrical or Mechanical EngineerImagelinks West Africa Ltd is seeking a highly skilled and experienced Electrical or Mechanical Engineer to join our team.Key Responsibilities:Supervise and monitor the maintenance and repair of mechanical systems and equipment to ensure prompt and efficient service.Advise the procurement and supply section on...

  • Electrical Engineer

    4 weeks ago

    Lagos, Lagos, Nigeria Ascentech Services limited Full time

    Job Title: Electrical Engineer - Tendering and DesignAscentech Services limited is seeking a highly skilled Electrical Engineer to join our team in Lagos. The successful candidate will be responsible for designing and maintaining sustainable engineering practices, conducting on-site investigations, and preparing technical blueprints and feasibility...

  • Senior Data Centre Operations Manager

    2 weeks ago

    Lagos, Lagos, Nigeria Sigma Consulting Group Full time

    Job Title: Senior Data Centre Operations ManagerFunction: Managing Data Centre and Facilities OperationsReporting to: Head Tx/Core & FacilitiesTravel Frequency: OccasionalWork Schedule: 8:00 AM - 5:00 PMDivision: InfrastructureDepartment: FacilitiesJob Grade: PermanentLocation: LagosSalary: 6-8 Million AnnuallyPurpose of the JobThe Senior Data Centre...

  • Software Engineer Director

    2 weeks ago

    Lagos, Lagos, Nigeria TALENT by venstrap Full time

    About the RoleAt Talent by venstrap, we are seeking a skilled Software Engineer Director to lead our engineering team and drive the development of our cutting-edge technology platform.Key ResponsibilitiesTake ownership of ensuring the scalability and reliability of our architecture.Enforce coding standards, conduct code reviews, and implement processes to...

  • Senior Software Engineering Manager

    4 weeks ago

    Lagos, Lagos, Nigeria TALENT by venstrap Full time

    Senior Software Engineering ManagerAt Talent by venstrap, we are building innovative products to revolutionize the beauty and wellness industry in Africa. Our cutting-edge technology empowers beauty professionals and businesses to streamline operations, enhance customer experiences, and boost overall efficiency.We are seeking a Senior Software Engineering...

  • Data Centre and Facilities Operations Manager

    4 weeks ago

    Lagos, Lagos, Nigeria Sigma Consulting Group Full time

    Job Title: Team Lead, FacilitiesFunction: Managing Data Centre and Facilities OperationsReporting to: Head Tx/Core & FacilitiesTravel Frequency: OccasionallyWork Schedule: 8:00 AM - 5:00 PMDivision: InfrastructureDepartment: FacilitiesJob Grade: PermanentLocation: LagosSalary: 6-8 Million AnnuallyPurpose of the JobThe Team Lead, Facilities is responsible for...

  • Ubuntu Engineering Delivery and Excellence Manager

    4 weeks ago

    Lagos, Lagos, Nigeria Canonical Full time

    We're seeking a Quality Engineering Manager to lead our Ubuntu Quality Engineering team, driving quality excellence and best DevOps practices.The role is technical, but the focus is on team growth, satisfaction, and collaboration.Responsibilities:Define and monitor quality metrics for the most popular Linux distroSet and manage expectations with other...