Scientific Computing Seminar

Date and Place: Thursdays and hybrid (live in 32-349/online via Zoom). For detailed dates see below!

Content

In the Scientific Computing Seminar we host talks of guests and members of the SciComp team as well as students of mathematics, computer science and engineering. Everbody interested in the topics is welcome.

List of Talks

Event Information:

  • Thu
    16
    Dec
    2021

    SC Seminar: Sharad Kakran

    12:00Online

    Sharad Kakran, TU Kaiserslautern

    Title:
    Generalization of Neural Predictors in Neural Architecture Search, Applied to Computer Vision

    Abstract:

    In recent years, the research topic “Neural Architecture Search” has gained a lot of popularity across the research community and industry, which mostly deals with searching for an architecture under predefined constraints for a task. Although in recent years, many sophisticated methods have been proposed to reduce the search time for exploring a search space, evaluation of so many architectures searched from a search space is computationally infeasible and this motivates the use of neural predictor which predicts the accuracy of searched architectures. However, the predictions of neural predictor strongly depend on how well it is trained which requires high quality of architecture-accuracy pairs, therefore involves a time and resource consuming process of training many sampled architectures from each new search space. Architectures, such as PSPNet, SSD, used in other computer vision tasks like semantic segmentation, object detection, share the same backbones from conventional image classification architectures, Resnet, VGG, therefore the search spaces across tasks overlap to some degree with common set of operations. Therefore we wish to investigate the question if knowledge from one task can be carried to another by using a neural predictor. A well trained neural predictor should learn a good embedding by encapsulating the information about neural architectures present in the search space such as how one operation affects another, what sets of operations result in good accuracy. We wish to evaluate how well the predictor generalises to other computer vision tasks with trained architectures sampled from the same search space.

    How to join

    The talk is held online via Zoom. You can join with the following link:
    https://uni-kl-de.zoom.us/j/63565018552?pwd=d2VvMENEN1QvNkhlS01helUwRGhYdz09