Data Engineer

We are looking for passionate Data Engineers to join our team

BSG Johannesburg

The BSG Exchange is situated in Houghton, Johannesburg, within walking distance of the Rosebank Gautrain station.

Data Engineer Role profile

Location: Johannesburg (hybrid: blend of work-from-home and on-site at client and office locations)

We are looking for Data Engineers who join our team to design and deliver enterprise-scale data platforms and pipelines for large organisations in South Africa.

You will work on modern cloud platforms across data, analytics and ML/AI. Your work will span the full data engineering lifecycle, from data ingestion and transformation through to production deployment and operationalisation.

Do you want to build enterprise-grade data platforms that solve complex business problems? Do you want to shape how organisations use data to drive better decisions and measurable value? Then you will enjoy this role.

Note: We give full consideration to every applicant’s fit to this role, so if you decide to apply and you do not hear from BSG within a maximum of a four-week period, please consider your application unsuccessful at this time.

Main purpose of the role

Data Engineers work in multi-skilled teams to design, build and operate scalable data platforms and pipelines.

You take ownership of data engineering delivery across client engagements. You translate business problems into data solutions and enable analytics and ML/AI use cases through high-quality, reliable data platforms.
You contribute to solution design, execution, and continuous improvement of engineering practices across the Data and ML/AI capability.

About the role

Minimum Qualifications:

  • 4 to 8 years relevant experience in data engineering or software engineering
  • Proven experience building and deploying data pipelines in enterprise environments
  • Experience working with large organisations and complex data ecosystems

Experience:

  • 4-8 years’ experience working in teams to build enterprise-grade software solutions
  • Experience with big data tools, such as found in the Hadoop ecosystem, is advantageous
  • Experience with AWS or MS Azure cloud data services is preferable

Technical Knowledge:

  • Data pipeline design and orchestration across batch and real-time use cases
  • Strong SQL and data modelling skills across relational and non-relational patterns
  • Programming in Python required, Java or Scala would be advantageous
  • Knowledge of Data streaming platforms such as Kafka, Pulsar, Redpanda or JetStream
  • Distributed data processing frameworks such as Spark
  • Cloud platforms such as AWS, Azure or GCP
  • Data warehousing, Data lake, or data mesh architectures
  • Data quality, lineage, and governance principles
  • Exposure to DevOps pipelines for building/deploying cloud-based solutions is required but specific DataOps or MLOps practices is advantageous
  • ML or AI experience strongly advantageous
  • Design and build scalable data pipelines that support analytics, reporting and machine learning use cases
  • Implement robust and reliable data ingestion, transformation and processing solutions across structured and unstructured data
  • Ensure data quality, lineage and governance across data platforms
  • Contribute to architecture design and selection of appropriate tools, platforms and frameworks
  • Support end-to-end delivery of data solutions from discovery through to production deployment
  • Enable Data Science and analytics teams through high-quality, well-structured datasets
  • Collaborate with cross-functional teams to solve complex business problems using data
  • Contribute to reusable assets, frameworks and engineering best practices
  • Support mentoring and capability development within the Engineering team
  • Strong problem-solving ability with focus on practical delivery
  • Ability to translate business requirements into technical data solutions
  • Strong understanding of the data engineering lifecycle and platforms
  • Clear communication with both technical and business stakeholders
  • Collaborative approach within multi-skilled delivery teams
  • Delivery focused with strong ownership and accountability
  • Quality driven with attention to detail and reliability

About you

  • Openness
  • Collaboration
  • Practical Focus
  • Delivery Focus
  • Empathy
  • Assertive
  • Proactive
  • Professional
  • Approachable
  • Good communicator
  • Holds self accountable
  • Organised and reliable
  • Delivery focused
  • Quality driven
  • Able to perform under pressure
  • Flexible and adaptable
  • Willing to travel

Note: We give full consideration to every applicant's fit to this role, so if you decide to apply and you do not hear from BSG within a maximum of a four week period, please consider your application unsuccessful at this time.

Contact Us

We love talking about change. If you've been inspired by anything you've read here, please get in touch.

Not readable? Change text. captcha txt