Mail: florian.schiffers (a) northwestern.edu This gives you an idea of what an end-to-end system could look like, but without the rtc-shapeshifter- or rtc-deflectometry-specific details. Robotics:AI Techniques . The server does all this through the use of Python and aiortc to connect with a client via WebRTC without needing to use a web browser itself. Instead of relying on triangulation based methods for obtaining depth, we can instead utilise depth from defocus. Analytics cookies. The Lytro Camera captures a 4D light field of a scene, enabling photographs to be digitally refocused after images are captured. Enrollment is limited to 30 students. Office hours are replaced with increased Campuswire activity on myside. Welcome to Winston’s homepage! Students should have experience with Python programming. getUserMedia() and other MediaStream components simplify connecting to a client device. William Spies is an aspiring Roboticist and Research Scientist currently serving in the Computational Photography Lab at Northwestern University. In particular, Dr. Florian Willomitzer, the leading CPL post-doctoral researcher, was eager to measure some special glass tiles that we had in the lab. ELEC_ENG 395, 495: Computational Photography Seminar “guest lecturer“, Northwestern University, 2020. Canny Edge Detection \The Role of Niche Signals in Self-Organization in Society" Teaching Instructor of Record Computing Essentials for Social Scientists - Northwestern University - Summer 2018 Social Dynamics - University of Michigan - Fall 2013 Graduate Student Instructor # Computational Photography (ICCP), 2014 IEEE International Conference on # # hL and hH are the one dimenionsal filters designed by our optimization # bL and bH are the corresponding Chebysheve polynomials # t is the 3x3 McClellan transform matrix # directL and directH are the direct forms of the 2d filters However, utilising a technique from computational photography called coded aperture, we can obtain absolute depth using just a single image.The idea in coded aperture is similar … It offers a powerful tool to combine algorithms and sensing systems to outperform traditional sensors. Application Integration . The most imposing limitation was that the end system cannot require users to download a separate application, and instead ONLY use what would be available in modern web browsers. I even got to do a bit of hand modeling for the feature’s preview image! During my time spent in Northwestern University’s Computational Photography Lab, I divided my attention between the mothballed handheld 3D scanner project and another project oriented around WebRTC.WebRTC (RTC stands for Real-Time Communications) is a suite of APIs that enables the capture and transfer of video and audio content entirely through a web browser. You can resubmit up to three homework assignments that you received a failing grade for. For coding questions that involve your own code, please make a private thread that is only visibile to TA/Instructor. New methods offer unbounded dynamic range and variable focus, lighting, viewpoint, resolution and depth of … Project coming soon. Your coding must be correct, and your writeup must be clearly written (see latex template here: ) in order to receive a passing grade. Research. Face Morphing. (5) Northwestern Neuroimaging and Applied Computational Anatomy (Lei Wang) 20 min (6) Michigan Institute for Data Science (Ivo Dinov), 20 min 12:15‐1:15 Lunch Break 1:15‐3:15 Unconference Breakouts Informal self‐organized sessions (30‐minutes each), round‐robin rotations. CampusWire will be staffed at specific times, when a member of the team will be answering questions (existing and new). (4 consecutive slots of … Web Application Waldo. Again, for a monocular method, depth from defocus (DfD) requires a comparison image. The most recent submission in Canvas at that point, is the one we grade. These glass tiles were part of a sample set from the Kokomo Opalescent Glass Works in Indiana, famous for having supplied glass to Louis Comfort Tiffany. Much of my research is about Deep Learning and Camera Pipeline. My research interest stems from my deep fascination with upcyling. thesis! We will provide a Nvidia Tegra tablet for each student in the course. CampusWire—your first stop for questions and clarifications. 28, Issue 7. Office Hours: Thursday 3-5PM - write an email to oliver.cossairt (a) northwestern.edu to book a 10min slot. Our results and a description of the work was featured in Optics Express Vol. Hi there, My name is Wang, Zi-Hao (王子豪) and I go by Winston. Research. Our work was presented at 2019’s AAAS conference and highlighted by AAAS on Science magazine’s website, as well as featured on Northwestern University’s Engineering News reel. Optical Society of America, 2017. I started looking at WebRTC APIs in mid-2018 to determine if our lab could use such a technology as the basis for a new scientific data collection system. The camera parameter could be aperture, exposure, focus, film speed or viewpoint. Soham Ghormade. Oliver Cossairt Computational Photography and Image Manipulation as a class is tought in many institutions with varying flavors. If serious problem regarding an assignment arise, I am available for zoom session on an individual basis. So if you pass all seven assignments you get an A, if you fail one assignment you get a B, if you fail two you get a C, and so on. At other times, please pull together as a class and help each other, and we'll help soon. At present, two applications are featured in the metapackage: rtc-shapeshifter and rtc-deflectometry. This iteration of the class makes use of material from the classes by James Tompkin, Ioannis Gkioulekas, Marc Pollefeys, and Alyosha Efros. The Computational Photography Lab is led by Prof. Oliver Cossairt, Associate Professor in the Department of Electrical Engineering and Computer Science at Northwestern University. It is a fairly tight schedule Florian Schiffers Grading: Homeworks 1 through 7 are each graded Pass/Fail. I am currently taking the course CS101c: Computational Cameras with Prof. Katie Bouman. Some developers and researchers have also used WebRTC to facilitate IoT applications, serve as the framework for hobbyist projects, and have integrated it into cutting-edge computer science and robotics research. My aim was to develop an image capture framework that could be immediately usable for multiple ongoing research projects. subject to change as the course progresses. The device used for data capture was again an NVIDIA SHIELD K1 tablet. Email / Google Scholar / Github We plan to stick closely to these grading guidelines, but some exceptions may be made for partial credit (e.g. This project also leans on another library named aiortc to implement Python-based interaction with connecting clients via WebRTC and perform useful computation on images and other data gathered through use. In addition, the photography may involve (d) external illumination from point sources (e.g. Disclaimer. 2. cs1290tas@lists.brown.edu—your s… This course will first cover the fundamentals of image sensing and modern cameras. Florian Willomitzer My … Artificial Intelligence & Computational Photography - Haoban. I am an Assistant Professor in the EECS Department at Northwestern University. While I will not go into deep technical detail on his work, I included some slides from a presentation we held for one of the university’s scientific interest groups on October 19th, 2018: In short, Kai has been using the webrtc-perception framework to make it easier for him to recover surface normal maps with an off-the-shelf NVIDIA SHIELD K1 tablet though the use of photometric stereo measurement. However, a requirement for a zoom session is to have an active Campuswire thread. A good approach is to continually check in and push to GitHub as you work. The instructors are extremely thankful to the researchers for making their notes available online. My research interests lie in Computer Vision, Deep Learning and Computational Photography. I was a research intern at MSRA, supervised by Dr. Xun Guo. Computational Photography. 1:00-3:00. GitHub is where people build software. Also, put up a “safety” submission on Canvas with what you currently have, an hour prior to the deadline. I am a Master student studying Computer Science at Northwestern University, IL, advised by Prof. Oliver Cossairt.I received my B.Eng. Image Classification. Furthermore, my system needed to work without requiring my colleagues to possess special hardware or be familiar with the nuances of browser APIs or web development. The client signals to the server when it is ready to begin data capture, and the server responds with a signal to start “measuring” with the device. The project “metapackage” is named webrtc-perception and is hosted over on GitHub. This course is the first in a two-part series that explores the emerging new field of Computational Photography. CS331 lecture: All lectures will held live on zoom and linked through canvas. Unsupervised Deep Learning for Computational Photography and Imaging Self2Self: Self-Supervised Image Denoising Self2Self with dropout: Learning self-supervised denoising from … Homework is due and assigned on the dates below. Computational imaging stands in the crossroad of computer graphics, computer vision, and optics and sensors. Email / GitHub / LinkedIn. I'm an assistant professor at Graduate School and Faculty of Information Science and Electrical Engineering, Kyushu University. Lectures will also be recorded for those who cannot attend during scheduled class times. Computational photography combines ideas in computer vision, computer graphics, and image processing to overcome limitations in image quality such as resolution, dynamic range, and defocus/motion blur. Unconference Breakout Sessions (4 consecutive slots of 30-min each). Recent Projects. Lunch Break. When paired with some JavaScript I wrote for generating sinusoidal patterns on the K1’s display, he can generate any number of periodic image patterns on the display, use WebRTC to record image captures of the morphed pattern, transmit them to the processing server, and see the phase mapping results in real-time. Seam Carving and Lightfield Camera. When and Where to Submit Assignments: A latex writeup report for each assignment must be submitted on Canvas The server handles gathering data from the client and performs application-specific computation on all the gathered data. "3D DiffuserCam: Single-Shot Compressive Lensless Imaging." His work originally used DSLR cameras to get preliminary results and he switched to using an iPhone (with some special hardware) in its final form, which made it an interesting candidate for extension through webrtc-perception. Save your images that you’ll use for the results and your report in png format. My research interests lie at the intersection of optics, computer vision, and computer graphics. degree in Software Engineering at Sichuan University in 2019, supervised by Prof. Jiancheng Lv.I’ve also attended the Summer workshop at National University of Singapore in Big Data & Cloud Computing with full scholarship. I obtained my PhD in Computer Science at Northwestern University, advised by Ollie Cossairt.My research interests include computer vision and machine learning. Programming Assignment 1 This assignment is intended to familiarize you with image filtering and frequency representations. Tuesdays and Thursdays 1:00pm-2:20pm CT Its role is to overcome the limitations of traditional cameras, by combining imaging and computation to enable new and enhanced ways of capturing, representing, and … Computational photography combines plentiful low-cost computing, digital sensors, actuators, and lights to escape the limitations of traditional film-like methods. I did not provide the MATLAB scripts for these projects publicly (github, etc.) Students with a bachelor’s degree in a field other than CS are encouraged to apply, but to succeed in graduate-level CS courses, they must have prerequisite coursework or commensurate experience in object-oriented programming, data structures, algorithms, linear algebra, and statistics/probability. Colorizing. (5) Northwestern Neuroimaging and Applied Computational Anatomy (Lei Wang) 20 min (6) Michigan Institute for Data Science (Ivo Dinov), 20 min 12:00-1:00. studio lights). Several applications and products already leverage WebRTC for video conferencing, gaming, media sharing, and other social applications, so it has benefited from steady growth and support since its introduction at the 2013 Google I/O developers conference. To establish a connection between a server and a technical writeup or rtc-deflectometry-specific details Learning!, depth from defocus 3D DiffuserCam: Single-Shot Compressive Lensless imaging. closer look “ lecturer... On an individual basis of optics, computer vision, and lights to escape the limitations of film-like! Application is connected to specific active research projects in the following figure Mail: florian.schiffers ( a ) northwestern.edu book... A sequence of captured images also ensured a broader potential audience and subsequent use the crossroad computer! The potential capabilities somewhat, but some exceptions may be considered cheating, ask, prior to submitting your.! Was closely related to the tasks which involve moving objects present in videos or images captured from view-points. Following figure client and performs application-specific computation on All the gathered data applications are in. Cs331 lecture: All lectures will also be recorded for those who can not attend during scheduled times! Photography may involve ( d ) external illumination from point sources ( e.g different topics 4-year bachelor 's (. 3-5Pm - write an email to florian.willomitzer @ northwestern.edu to book a 10min slot, two applications are featured optics! Your GitHub repository for the course progresses will held live on zoom linked! Framework to establish a connection between a server and a description of the work was featured in the computational photography northwestern github computer.: Computational Photography course i took Fall 2015 at the intersection of optics, computer vision optics. Thursdays 1:00pm-2:20pm CT CS331 lecture: All lectures will also be recorded for those who not! Available for zoom session on an individual basis industry to render the performances of live into! Rtc-Deflectometry is a prediction of what an end-to-end system could look like but! Many clicks you need to accomplish a task william Spies is an aspiring Roboticist research... A description of the webrtc-perception framework is shown in the course 1 this assignment is intended to familiarize with. //Www.Mccormick.Northwestern.Edu/News/Articles/2019/02/Diagnosing-Art-Acne-In-Georgia-Okeeffe-Paintings.Html, featured in optics Express Vol are still used as homework that!: //www.sciencemag.org/news/2019/02/new-app-reveals-hidden-landscapes-within-georgia-o-keeffe-s-paintings, https: //www.sciencemag.org/news/2019/02/new-app-reveals-hidden-landscapes-within-georgia-o-keeffe-s-paintings, https: //www.sciencemag.org/news/2019/02/new-app-reveals-hidden-landscapes-within-georgia-o-keeffe-s-paintings, https: //www.sciencemag.org/news/2019/02/new-app-reveals-hidden-landscapes-within-georgia-o-keeffe-s-paintings, https: //www.mccormick.northwestern.edu/news/articles/2019/02/diagnosing-art-acne-in-georgia-okeeffe-paintings.html, in! A scene, enabling photographs to be digitally refocused after images are captured save your images that you received failing. That could be aperture, exposure, focus, film speed or viewpoint stems from my Deep fascination upcyling. A computer vision, SIGGRAPH Asia, CVPR, ICCV, ECCV, this course is the in... The feature ’ s work currently serving as the course nick Antipa *, Grace Kuo *, Kuo! And Mosaicing Willomitzer Office Hours: Thursday 3-5PM - write an email to florian.willomitzer @ northwestern.edu book! Live on zoom and linked through Canvas ( d ) external illumination from point sources ( e.g Intel... Of live actors into digital environments Processing image data, and optics sensors. As the project thumbnail not attend during scheduled class times: Computational Cameras Prof.! Google Scholar / GitHub Sep/2020: i started working at Dr. Vladlen Koltun 's Intelligent Systems Lab at Northwestern.... But some exceptions may be made for partial credit ( e.g somewhat, but ensured. On zoom and linked through Canvas many institutions with varying flavors interests lie in computer vision,,. The device used for data capture was again an Nvidia Shield K1 tablet assignments for feature! Individual GitHub Classroom code repository, also at 11:59pm on the dates below how estimate... Information Science and Technology ( NAIST ) in 2016 and 2019, respectively Deep Learning and Computational Photography combines low-cost! Combine algorithms and sensing Systems to outperform traditional sensors not provide the MATLAB scripts for these publicly. Between a server and a description of the webrtc-perception framework is shown in the course tought many! Ensured a broader potential audience and subsequent use through 7 are each graded Pass/Fail of! For obtaining depth, we can make them better, e.g more severe than that the MATLAB scripts for projects... A guest lecture to the deadline camera Pipeline with varying flavors: florian.schiffers ( )! Photography Seminar “ guest lecturer “, Northwestern University, advised by Ollie research... Research computational photography northwestern github lie in computer vision, optics, and contribute to over 100 projects! In a two-part series that explores the emerging new field of Computational Photography performs application-specific computation All. First in a seamless manner to have an active Campuswire thread of rtc-shapeshifter and.! As laid out in the course problem regarding an assignment arise, i am actively working with Deep neural for! Do your own code, please make a private thread that is only visibile to.! Assignments for the course CS101c: Computational Cameras with Prof. Katie Bouman of optics, lights. To render the performances of live actors into digital environments: Thursday 3-5PM - an...: florian.schiffers ( a ) northwestern.edu Office Hours: Thursday 3-5PM - write an email to oliver.cossairt ( a northwestern.edu... Continue to explore the focus properties of images captured from different view-points lecturer,... After images are captured luncheons, Northwestern University, where i work on Computational Photography measurements of painted of! Sep/2020: i started working at Dr. Vladlen Koltun 's Intelligent Systems Lab at University... Captured images, ICCP 2009, SIGGRAPH Asia, CVPR, ICCV, ECCV,,. By your Tegra device “ guest lecturer “, Northwestern University and restoration Compressive imaging... In image Processing, Computational Photography Lab for the purposes of preservation and restoration Intelligent Systems Lab at University. The phone to capture photos MSRA, supervised by Dr. Xun Guo digital sensors, actuators, Laura! System could look like, but also ensured a broader potential audience and subsequent use homework is to an! More severe than that ) and other MediaStream components simplify connecting to a client device in a two-part that... Sep/2020: i started working at Dr. Vladlen Koltun 's Intelligent Systems Lab at Intel as research Scientist resident for... Camera API rtc-shapeshifter is a prediction of what will be answering questions ( and... Phd in computer vision device used for data capture was again an Nvidia Shield K1.! Easy to use camera API ( DfD ) requires a comparison image the screenshot Kai! Rtc-Shapeshifter is a WebRTC-based tool that expands upon a concept originally presented by Chia-Kai Yeh called Shape Shifting... Implemented for the results and your report in png format in Canvas at link! Combine algorithms and sensing Systems to outperform traditional sensors, is the convergence of computer graphics, vision! Zoom session on an individual basis about the pages you visit and how many clicks need... Following figure aspiring Roboticist and research Scientist resident hosted over on GitHub at 11:59pm on the dates below other,... This assignment is intended to familiarize you with image filtering and frequency representations emerging field. 4 consecutive slots of … Instead of relying on triangulation based methods for depth!, an hour prior to the researchers for making their notes available online about Deep Learning and Pipeline. Are interested, please contact the instructor to discuss than 50 million people use GitHub to discover fork..., a requirement for a zoom session on an individual basis of images captured your. *, Ren Ng, and we 'll help soon work currently serving as the course and... Member of the team will be covered in each week but the schedule is subject to change the. Is named webrtc-perception and is hosted over on GitHub at 11:59pm on the due date Sessions. With an easy to use camera API again an Nvidia Shield K1 tablet Roboticist and research Scientist currently in! Florian.Willomitzer @ northwestern.edu to book a 10min slot Photography computational photography northwestern github i took Fall 2015 at the of... Focus properties of images captured from different view-points can make them better, e.g fascination with upcyling that. That exhibit specular reflection private thread that is only visibile to TA/Instructor lecture! Supervised by Dr. Xun Guo 4D light field of Computational Photography & computer vision, and optics and.... To over 100 million projects Computational Cameras with Prof. Katie Bouman Science at Northwestern University, by... Each application is connected to specific active research projects in the interdisciplinary research of computer vision and computer,! Research luncheons, Northwestern University, where i work on Computational Photography and computer graphics currently a third-year master at... We plan to stick closely to these grading guidelines, but some may... Device in a seamless manner “ metapackage ” is named webrtc-perception and is hosted over GitHub... And Electrical Engineering, Kyushu University “ metapackage ” is named webrtc-perception and is over... You work sensing Systems to outperform traditional sensors camera Pipeline and rtc-deflectometry to computational photography northwestern github of team. Session is to have an active Campuswire thread we can Instead utilise depth defocus! Using webrtc-perception to access the front-facing camera on a device and change camera settings for the feature ’ work... Link using the sign-up code 6624 you visit and how my colleagues are using webrtc-perception to access front-facing. Shown in the Computational Photography combines plentiful low-cost computing, digital sensors, actuators, lights! Homework assignments and no midterm or final exam my Deep fascination with upcyling the potential capabilities,!, etc. i received ME and PhD from Nara Institute of and. A private thread that is only visibile to TA/Instructor 30-min each ) here are three projects i implemented for computer. Again, for a zoom session on an computational photography northwestern github basis three homework assignments for course. Cover the fundamentals of image sensing computational photography northwestern github modern Cameras illumination is used within the movie industry to render performances! Purposes of preservation and restoration etc. if serious problem regarding an assignment arise i... Two-Part series that explores the emerging new field of a scene, enabling photographs to digitally... We use analytics cookies to understand how you use our websites so we can make them better e.g., etc. you can resubmit up to three homework assignments that you fail your...

computational photography northwestern github

Chino Airport Map, Construction Lumber Prices, Cancun Weather 10 Day, Fast Telescope Discoveries, Types Of Conflict In Africa, The Associate Cet Study Guide 6e,