GitHub

Temporal Attention, Multi-Resolution Fusion of Satellite Image Time-Series

This repository holds the model and training scripts related to Temporal Attention, Multi-Resolution Fusion (TAMRF) of Satellite Image Time-Series . A complete and generic formulation of the SITS ...
IEEE

GetFed: Accurate, Differentially Private Federated Learning With GAN-Based Data Generation

Abstract: Federated Learning (FL) aims to train neural network models using distributed data resources from multiple clients without sharing raw data. One of the key challenges in FL is ...
IEEE

Training Large Models on Heterogeneous and Geo-Distributed Resource with Constricted Networks

Abstract: As the computational demands driven by large model technologies continue to grow rapidly, leveraging GPU hardware to expedite parallel training processes has emerged as a commonly-used ...
GitHub

The missing tiktoken training code

A lightweight Rust library for training GPT-style BPE tokenizers. The tiktoken library is excellent for inference but doesn't support training. The HuggingFace tokenizers library supports training but ...