PS7 - Data, Datasets, and Extraction Methods Context
This document consolidates the data, datasets, and extraction methods context for Problem Statement 7 (AI-enabled detection of exoplanets from noisy astronomical light curves) for the Bharatiya Antariksh Hackathon 2026.
1. Problem Core and Key Concepts
A planet crossing its host star blocks a fraction of the star's light. The main challenge is to extract this weak, periodic dip from noisy light curves, and then distinguish true transiting planets from false positives (impostors like eclipsing binaries, stellar spots, or detector artefacts).
Physics of the Transit
A transit is characterised by three geometric parameters:
- Depth ($\delta$): The fractional drop in brightness. It is proportional to the ratio of the projected areas:
$$\delta = \frac{\Delta F}{F} = \left(\frac{R_p}{R_\star}\right)^{2}$$ where $R_p$ is the planet radius and $R_\star$ is the star radius. For a Jupiter-size planet, $\delta \approx 1\%$. For an Earth-size planet, $\delta \approx 0.0084\%$ (84 ppm), which is often below the per-point noise floor.
- Duration ($T_{14}$): The time from first to last contact, determined by orbital speed and the impact parameter $b$ (how centrally the planet crosses the star):
$$T_{14} \approx \frac{P}{\pi} \frac{R_\star}{a} \sqrt{1-b^{2}}$$
- Period ($P$): The orbital period (the time between repeating dips), which determines the semi-major axis $a$ via Kepler's third law.
The Four Target Classes
- Planet Transit: Shallow, flat-bottomed U-shape due to stellar limb darkening. No secondary eclipses. Odd and even transits have matching depths.
- Eclipsing Binary (EB): Often V-shaped due to grazing stellar disks. Shows a secondary eclipse half a period later (the companion star emits its own light). Odd and even transits often have mismatching depths (primary versus secondary eclipses). Dips are typically much deeper than planet transits.
- Blend or Contamination: Background eclipsing binary light is diluted in the target star's aperture, making a deep stellar eclipse look like a shallow planet transit. Identified by a centroid offset (the photo-centre shifts position during the dip) and inconsistency with host star parameters.
- Other / Artefact / Non-Transiting: Stellar variability (pulsation, rotating spots), instrumental effects (momentum dumps, spacecraft jitter, thermal ramps), or flat quiet stars with only noise.
2. Dataset Information
The data environment for PS7 involves several components, ranging from massive public catalogs to curated training sets:
Raw and Sector Light Curve Data
- Source: TESS (Transiting Exoplanet Survey Satellite) high-cadence data from the MAST archive.
- Cadence: TESS short-cadence measures stellar brightness every 2 minutes. (For comparison, Kepler long-cadence is every 30 minutes).
- Data Volume: One sector of high-cadence data comprises approximately 20,000 to 30,000 light curves.
- Storage Footprint: About 30 to 60 GB raw per sector.
- Format: Time-series of normalised, relative flux. The starting point is usually the PDCSAP (Pre-search Data Conditioning Simple Aperture Photometry) flux, where common spacecraft systematics have already been co-trended out.
TESS Input Catalog (TIC)
- Total Size: 440 GB.
- Content: Approximately 1.7 billion rows of stellar metadata.
- Usage: For this project, only a few thousand rows of metadata lookups (stellar radius, mass, temperature) are required for the target stars, resulting in a tiny active memory footprint of a few megabytes.
Curated Labelled Dataset for Training
- Source: A curated, labelled dataset provided by ISRO mentors, supplemented by public confirmed planets and known eclipsing binaries.
- Classes: Pre-classified examples of planets, eclipsing binaries, blends, and non-transiting/other stars.
- Size: Relatively small, consisting of a few thousand training examples (not gigabytes). This makes training highly efficient and feasible on standard hardware (16 GB RAM, GPU-optional).
3. Extraction Methods and Pipeline Architecture
The recommended pipeline splits the problem into two distinct layers: Layer 1 for signal detection and extraction, and Layer 2 for machine learning classification.
+------------------+ +------------------------+ +--------------------------+
| Raw Light Curve | --> | Layer 1: Detection | --> | Layer 2: Classification |
| (Time Series) | | (Detrend & Period Search)| | (Fold, Feature Eng & ML) |
+------------------+ +------------------------+ +--------------------------+
Layer 1: Detection and Preprocessing (Signal Processing)
- Detrending (Flattening):
- Method: Tukey biweight time-windowed slider with a window size of approximately 3 times the maximum expected transit duration. This removes slow stellar variability and instrumental drifts without warping the brief transit dips.
- Alternative: Spline with a Huber estimator for highly active stars.
- Reference Tool:
wotan(Hippke et al. 2019).
- Periodicity Search:
- Method: Transit Least Squares (TLS), which fits a physical limb-darkened transit shape rather than a simplistic box.
- Sensitivity: TLS provides approximately 10% higher detection efficiency at a matched false-alarm rate compared to the Box Least Squares (BLS) algorithm. It recovers ~93% of small planets compared to BLS's ~76%.
- Threshold: A signal detection efficiency (SDE) threshold between 7 and 9 is standard (representing a ~1% false-positive rate). This corresponds to the TESS SPOC matched-filter threshold of Multiple Event Statistic (MES) = 7.1 sigma.
- Reference Tool:
transitleastsquares(Hippke and Heller 2019).
- Phase-Folding:
- Fold the full light curve at the detected orbital period so that all periodic dips align and stack, suppressing white noise and amplifying the transit signal.
Layer 2: Feature Engineering and Classification (Machine Learning)
- Feature Extraction: Instead of training a deep neural network directly on raw folded light curves (which often fails to generalise from simulations to real noisy data), the recommended approach is a feature-based classifier. The most discriminating features extracted from the folded curve and stellar metadata are:
- Odd-even depth difference: To flag eclipsing binaries with alternating primary and secondary eclipses.
- Secondary eclipse depth and significance: To identify stellar companions.
- Transit shape metrics: The ratio of ingress/egress times to the total duration, and overall "boxiness" (distinguishing U-shape from V-shape).
- Centroid offset: Measuring pixel-level photo-centre motion during the dip to identify background blends.
- Stellar parameters: Depth relative to the stellar radius.
- Signal-to-Noise Ratio (SNR) or MES.
- Classifier Model:
- Architecture: Gradient-Boosted Decision Trees (GBDTs) like XGBoost, LightGBM, or CatBoost.
- Performance: Peer-reviewed benchmarks (Malik et al. 2022) show that GBDTs utilizing engineered shape features match the performance of heavy deep convolutional neural networks (CNNs) while being far more interpretable, faster to train on CPUs, and robust against noise.
- Class Imbalance Mitigation: Since planets are rare, the classifier is trained using balanced class weights, synthetic augmentation, and 10-fold cross-validation. Performance is evaluated using PR-AUC (Precision-Recall Area Under Curve) and confusion matrices rather than raw accuracy.
Post-Classification Validation
- Parameter Fitting (Forward Modeling):
- Method: Fit the Mandel and Agol analytical transit model to the folded data using Markov Chain Monte Carlo (MCMC) to recover posterior probability distributions for $R_p/R_\star$, $a/R_\star$, inclination, and limb-darkening coefficients.
- Reference Tool:
batman(Kreidberg 2015).
- Statistical Validation:
- Method: Compute false-positive probabilities (FPP) using Bayesian population-synthesis models.
- Threshold: Candidates are validated if the False Positive Probability (FPP) is less than 0.015 and the Nearby False Positive Probability (NFPP) is less than 0.001.
- Reference Tool:
TRICERATOPS(Giacalone et al. 2021).
- Injection-Recovery Grid:
- Run synthetic transit injections (log-spaced in period and radius-ratio, with ~50 injections per cell) to quantify the exact detection and classification completeness limit of the entire pipeline.