DEV Community

munimv2 profile picture

munimv2

404 bio not found

Joined Joined on  github website
All five predictions reversed: in AI essay feedback, short quotes and strong essays get the most changed quotes

All five predictions reversed: in AI essay feedback, short quotes and strong essays get the most changed quotes

Comments
3 min read

Want to connect with munimv2?

Create an account to connect with munimv2. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Replicating a PyPI dependency-pinning number: the published 29% exact-pin share drops to 9-17% on fresh latest-release data

Replicating a PyPI dependency-pinning number: the published 29% exact-pin share drops to 9-17% on fresh latest-release data

Comments
5 min read
Follow-up: 95.7% of GLM-4.7's quotes keep the student's words once formatting is set aside

Follow-up: 95.7% of GLM-4.7's quotes keep the student's words once formatting is set aside

Comments
3 min read
PyPI environment markers: popular packages gate deps on python_version and platform 5.6x more than the long tail (30% vs 5%)

PyPI environment markers: popular packages gate deps on python_version and platform 5.6x more than the long tail (30% vs 5%)

Comments
4 min read
Picking the longest answer scores 43% on OpenBookQA and ~chance on ARC: a per-benchmark length-shortcut census

Picking the longest answer scores 43% on OpenBookQA and ~chance on ARC: a per-benchmark length-shortcut census

Comments
4 min read
I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?

I audited 8,946 published AI feedback reports on IELTS essays: do they quote the student exactly?

Comments
3 min read
Is 'neutral is the hardest NLI label' true in every text domain? Splitting ANLI's verifier agreement by (genre, class)

Is 'neutral is the hardest NLI label' true in every text domain? Splitting ANLI's verifier agreement by (genre, class)

Comments
4 min read
PyPI keyword strings: popular packages use commas and phrases more, yet the long tail is more parse-ambiguous (41% vs 38%)

PyPI keyword strings: popular packages use commas and phrases more, yet the long tail is more parse-ambiguous (41% vs 38%)

Comments
4 min read
Popular PyPI packages declare keywords more often (49% vs 38%) but list fewer of them (median 4 vs 5)

Popular PyPI packages declare keywords more often (49% vs 38%) but list fewer of them (median 4 vs 5)

Comments
4 min read
Your scanner's blind spot for self-hosted apps is policy, not accident — and neither ecosystem coverage nor import lag explains it away

Your scanner's blind spot for self-hosted apps is policy, not accident — and neither ecosystem coverage nor import lag explains it away

Comments
4 min read
Eight pre-registered tests on U.S. power plants that slip a month: what held, and what I take back

Eight pre-registered tests on U.S. power plants that slip a month: what held, and what I take back

Comments
2 min read
1,115 more DRAT proofs: Proposition 39 on the way to A(8) <= 10

1,115 more DRAT proofs: Proposition 39 on the way to A(8) <= 10

Comments
10 min read
Inside ANLI's verifier file: four ways to read 29,803 human votes on an adversarial benchmark

Inside ANLI's verifier file: four ways to read 29,803 human votes on an adversarial benchmark

Comments
5 min read
Do popular PyPI packages declare themselves typed more? Yes, 1.8x — but the 'Typing :: Typed' label undercounts real typing

Do popular PyPI packages declare themselves typed more? Yes, 1.8x — but the 'Typing :: Typed' label undercounts real typing

Comments
3 min read
PyPI's JSON API invents a project_urls 'Homepage' from the legacy Home-page field — it can't measure PEP 753 migration

PyPI's JSON API invents a project_urls 'Homepage' from the legacy Home-page field — it can't measure PEP 753 migration

Comments
4 min read
Do popular PyPI packages use modern Markdown READMEs more? No — the head clings to legacy rST (29% vs 5%)

Do popular PyPI packages use modern Markdown READMEs more? No — the head clings to legacy rST (29% vs 5%)

Comments
4 min read
What did the model get wrong? Splitting ANLI's verifier agreement by the adversary's own error

What did the model get wrong? Splitting ANLI's verifier agreement by the adversary's own error

Comments
4 min read
Do popular PyPI packages flag non-English languages more? No — the long tail does (7.7% vs 2.4% of declarers)

Do popular PyPI packages flag non-English languages more? No — the long tail does (7.7% vs 2.4% of declarers)

Comments
3 min read
Does ANLI's 'neutral is hardest' survive its rounds? A Simpson's-paradox check on verifier agreement

Does ANLI's 'neutral is hardest' survive its rounds? A Simpson's-paradox check on verifier agreement

Comments
5 min read
Do popular PyPI packages rely on 'OS Independent'? No — the long tail does (81% vs 72%); the head names real platforms

Do popular PyPI packages rely on 'OS Independent'? No — the long tail does (81% vs 72%); the head names real platforms

Comments
3 min read
A U.S. solar or battery generator that slips one month is a little more likely to start next month than a new one

A U.S. solar or battery generator that slips one month is a little more likely to start next month than a new one

Comments
2 min read
Are popular PyPI packages for a broader audience? No — 97% of head declarers tag 'Developers' (vs 85%), same 13-of-14 span

Are popular PyPI packages for a broader audience? No — 97% of head declarers tag 'Developers' (vs 85%), same 13-of-14 span

Comments
4 min read
Which NLI labels are least decisive? A per-class and per-genre annotator-agreement tour of SNLI, MultiNLI and ChaosNLI

Which NLI labels are least decisive? A per-class and per-genre annotator-agreement tour of SNLI, MultiNLI and ChaosNLI

1
Comments 1
3 min read
Do popular PyPI packages choose deeper Topic paths? Barely (3.29 vs 3.25) — and the extra depth is template boilerplate

Do popular PyPI packages choose deeper Topic paths? Barely (3.29 vs 3.25) — and the extra depth is template boilerplate

Comments
4 min read
A powered test: do small AI models quote a student's misspelling back less exactly? (No clear difference)

A powered test: do small AI models quote a student's misspelling back less exactly? (No clear difference)

Comments
3 min read
Does the popular PyPI head pile into one framework? No — the long tail is more concentrated (29% vs 21%), driven by Odoo

Does the popular PyPI head pile into one framework? No — the long tail is more concentrated (29% vs 21%), driven by Odoo

Comments
4 min read
Where are a benchmark's gold labels least decisive? A per-genre annotator-agreement census of MultiNLI

Where are a benchmark's gold labels least decisive? A per-genre annotator-agreement census of MultiNLI

Comments
5 min read
Do PyPI long-tail packages copy PyPy boilerplate? No: popular packages advertise non-CPython support more (72% vs 55%)

Do PyPI long-tail packages copy PyPy boilerplate? No: popular packages advertise non-CPython support more (72% vs 55%)

Comments
4 min read
Check whether AI feedback quotes your student exactly, with one offline HTML file

Check whether AI feedback quotes your student exactly, with one offline HTML file

Comments
2 min read
Do popular PyPI packages advertise a fresher Python matrix? Yes: the tail's newest declared version is EOL 29% vs 8%

Do popular PyPI packages advertise a fresher Python matrix? Yes: the tail's newest declared version is EOL 29% vs 8%

Comments
4 min read
A planned U.S. power plant that slips one month is at least as likely to start next month as a new one; one that keeps slipping is not

A planned U.S. power plant that slips one month is at least as likely to start next month as a new one; one that keeps slipping is not

Comments
2 min read
Do PyPI projects swap keywords for a missing Topic classifier? No: projects with a Topic use keywords 2x as often

Do PyPI projects swap keywords for a missing Topic classifier? No: projects with a Topic use keywords 2x as often

Comments
3 min read
When does PyPI publish? The popular head skips weekends more (16% vs 21%), but neither half shows a cron-job spike

When does PyPI publish? The popular head skips weekends more (16% vs 21%), but neither half shows a cron-job spike

Comments
4 min read
No element of rank 4 at (8, 11): one step closer to A(8) <= 10

No element of rank 4 at (8, 11): one step closer to A(8) <= 10

Comments
14 min read
When a benchmark's gold is NOT the annotator majority: two reproducible censuses on ANLI and ChaosNLI

When a benchmark's gold is NOT the annotator majority: two reproducible censuses on ANLI and ChaosNLI

Comments
4 min read
Does the PyPI long tail over-claim maturity? No: 72% of popular declarers say Production/Stable vs 23% of the tail

Does the PyPI long tail over-claim maturity? No: 72% of popular declarers say Production/Stable vs 23% of the tail

Comments
4 min read
Do popular PyPI packages write longer summaries? No: they write terser one-liners but much longer READMEs

Do popular PyPI packages write longer summaries? No: they write terser one-liners but much longer READMEs

Comments
4 min read
Can you re-derive a benchmark's gold labels from its raw annotator votes? Two reproducible censuses on SNLI and MultiNLI

Can you re-derive a benchmark's gold labels from its raw annotator votes? Two reproducible censuses on SNLI and MultiNLI

Comments
4 min read
Does popularity buy frequent PyPI releases? No, it buys regular ones: a head-vs-tail census of release cadence

Does popularity buy frequent PyPI releases? No, it buys regular ones: a head-vs-tail census of release cadence

Comments
5 min read
Why fewer U.S. power plants come online in their planned month: mostly not the solar and battery boom

Why fewer U.S. power plants come online in their planned month: mostly not the solar and battery boom

Comments
2 min read
Does PyPI's long tail ship broad wheels? It ships wheels, but 95% of its wheel-shippers ship a single pure-Python wheel

Does PyPI's long tail ship broad wheels? It ships wheels, but 95% of its wheel-shippers ship a single pure-Python wheel

Comments
5 min read
For one month, EIA's U.S. power plant inventory listed 28 reactors retired before 2002

For one month, EIA's U.S. power plant inventory listed 28 reactors retired before 2002

Comments
2 min read
When the annotation gives away the answer: three reproducible leakage censuses on OpenBookQA, SciQ and QASC

When the annotation gives away the answer: three reproducible leakage censuses on OpenBookQA, SciQ and QASC

Comments
4 min read
Is PyPI's long tail messier? Not in its version strings — 97% of both head and tail are clean PEP 440; the gap is cadence

Is PyPI's long tail messier? Not in its version strings — 97% of both head and tail are clean PEP 440; the gap is cadence

Comments
5 min read
When a student misspells a word, does a small AI model quote it back exactly less often? A preregistered test came back underpowered

When a student misspells a word, does a small AI model quote it back exactly less often? A preregistered test came back underpowered

Comments
4 min read
How do PyPI packages write their Python-version requirement? A head-vs-tail census: the long tail caps Python MORE

How do PyPI packages write their Python-version requirement? A head-vs-tail census: the long tail caps Python MORE

Comments
4 min read
Popular PyPI packages carry more metadata — but nearly 9x more legacy reStructuredText READMEs than the long tail

Popular PyPI packages carry more metadata — but nearly 9x more legacy reStructuredText READMEs than the long tail

Comments
4 min read
Fewer U.S. generators planned for next month are operating in it than ten years ago

Fewer U.S. generators planned for next month are operating in it than ten years ago

Comments
2 min read
Do popular PyPI packages pull in more dependencies? Their runtime footprint is identical to the long tail -- the whole gap is optional extras

Do popular PyPI packages pull in more dependencies? Their runtime footprint is identical to the long tail -- the whole gap is optional extras

Comments
4 min read
Can you find a PyPI package's source code? A head-vs-tail census: the long tail is 7x more likely to link to nothing

Can you find a PyPI package's source code? A head-vs-tail census: the long tail is 7x more likely to link to nothing

Comments
4 min read
Does PyPI's long tail still ship wheels? A full head-vs-tail census of 6,000 latest releases

Does PyPI's long tail still ship wheels? A full head-vs-tail census of 6,000 latest releases

Comments
3 min read
A(7) <= 8: the last 45 instances close (B6), and Z_4^13 x Z_2^8 is settled

A(7) <= 8: the last 45 instances close (B6), and Z_4^13 x Z_2^8 is settled

Comments
12 min read
Do SNLI and MultiNLI share any examples? Ten reproducible censuses of gold-label integrity in NLI and QA benchmarks

Do SNLI and MultiNLI share any examples? Ten reproducible censuses of gold-label integrity in NLI and QA benchmarks

Comments
3 min read
How often do PyPI packages yank a broken release? A full-ecosystem census: ~1 in 4 popular packages, ~1 in 32 in the long tail

How often do PyPI packages yank a broken release? A full-ecosystem census: ~1 in 4 popular packages, ~1 in 32 in the long tail

Comments
5 min read
I expected PyPI's long tail to have messier version metadata. A full-ecosystem census proved me wrong.

I expected PyPI's long tail to have messier version metadata. A full-ecosystem census proved me wrong.

Comments
4 min read
Do small AI models quote English learners' essays word for word? Two preregistered studies

Do small AI models quote English learners' essays word for word? Two preregistered studies

Comments
4 min read
EIA's November 2024 generator file leaves out 277 retired U.S. units that the months around it list

EIA's November 2024 generator file leaves out 277 retired U.S. units that the months around it list

Comments
2 min read
30 ways a model file can bite you: a vendor-neutral scanner coverage matrix (three new 2026 vectors)

30 ways a model file can bite you: a vendor-neutral scanner coverage matrix (three new 2026 vectors)

Comments
4 min read
25 reproducible audits of the metrics and gold labels behind LLM benchmark scores

25 reproducible audits of the metrics and gold labels behind LLM benchmark scores

Comments
4 min read
PUDL's EIA-860M changelog has kept stale U.S. power plant statuses since 2016

PUDL's EIA-860M changelog has kept stale U.S. power plant statuses since 2016

Comments
2 min read
loading...