Skip to content

Instantly share code, notes, and snippets.

@spencergotowork

spencergotowork/GoogleSummerofCode2022.md Secret

Created September 23, 2022 09:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save spencergotowork/4877de7aa989a7e737bb699f19249e74 to your computer and use it in GitHub Desktop.
Save spencergotowork/4877de7aa989a7e737bb699f19249e74 to your computer and use it in GitHub Desktop.
Download ZIP
This is the final report for my Google Summer of Code 2022 project under the auspices of OpenVINO Toolkit organization.
Raw
GoogleSummerofCode2022.md

Google Summer of Code 2022

Contributor: Ran Piao (Ran Piao)

Organization: OpenVINO Toolkit

Project Name: 3D Jupyter Notebooks and WebGL Integration for OpenVINO (project page)

GitHub repository: spencergotowork/openvino_notebooks

Mentor

Abstract

OpenVINO Notebooks is a collection of ready-to-run Jupyter notebooks for learning and experimenting with the OpenVINO™ Toolkit. In machine learning, many of the tasks may be much better visualized and understood if we provide a 3D or 4D (space and time) perspective to the input video or images. So this project aims to provide the beginner-friendly Jupyter 3D engine for machine learning visualization along with WebGL integration.

As an attempt to integrate 3D display with OpenVINO, it can be implemented in many ways. In this project, I used the 3D human pose estimation model and Facemesh model as demonstrations, and used OpenCV and WebGL in two different ways to achieve 3D display effect respectively. You can find more information about this model in the Github repository. The code works well on Windows and Ubuntu operating systems.

Contributor's Work

As a contributor to Google Open Source Summer 2022, my main task is to add new features to OpenVINO Notebooks. My code submitted pull request as one of the demos, held weekly synchronous meetings, and my mentor posted them on Disscution. Each week I compile my characters into short blogs, and a few of the more content blogs I publish to make them accessible to more people.

Deliverables

  • demos containing portable graphical interfaces.
  • Blogs posts documenting the code process.
  • Minutes of weekly meeting disscution.
  • GSoC 2022 Project Final Report

Future Work

Enhance the display effect of OpenCV method. Now the graphical interface has supported point cloud data, and new functions will be added according to the needs of other Demo in the future

Conclusion

It was a very memorable experience and I am very grateful to my two mentors for their guidance. As a student majoring in information security, I learned a lot from this project outside of my major, which was very interesting

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment