APT hosed, segving in libapt-pkg-libc6.9-6.so.4.8.1

Norbert Preining · External Since: Oct 13, 2004 Posts: 838

Today: apt0.7.23 and bang:
$ apt-get update
....
99% [11 Packages rred 2154496] [Waiting for headers] [Waiting for headers]Segmentation fault (core dumped)

WARNING to everyone.

Program terminated with signal 11, Segmentation fault.
#0 0x00007fdea4ad8d6d in pkgAcqIndex::Failed(std::string, pkgAcquire::MethodConfig*) () from /usr/lib/libapt-pkg-libc6.9-6.so.4.8

Best wishes

Norbert

-------------------------------------------------------------------------------
Dr. Norbert Preining <preining.TakeThisOut@logic.at> Vienna University of Technology
Debian Developer <preining.TakeThisOut@debian.org> Debian TeX Group
gpg DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
-------------------------------------------------------------------------------
SAFFRON WALDEN (n.)
To spray the person you are talking to with half-chewed breadcrumbs or
small pieces of whitebait.
--- Douglas Adams, The Meaning of Liff

--
To UNSUBSCRIBE, email to debian-devel-REQUEST.TakeThisOut@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster.TakeThisOut@lists.debian.org

Michael Vogt · External Since: Jun 28, 2005 Posts: 183

On Fri, Aug 28, 2009 at 03:55:26PM +0200, Norbert Preining wrote:
> Today: apt0.7.23 and bang:
> $ apt-get update
> ..
> 99% [11 Packages rred 2154496] [Waiting for headers] [Waiting for headers]Segmentation fault (core dumped)
>
>
> WARNING to everyone.

Thanks for your warning.

> Program terminated with signal 11, Segmentation fault.
> #0 0x00007fdea4ad8d6d in pkgAcqIndex::Failed(std::string, pkgAcquire::MethodConfig*) () from /usr/lib/libapt-pkg-libc6.9-6.so.4.8

It looks like this is releated to the new code that adds lzma support
for Package file downloads and the option to configure in what order
the compression types should be used. I can not reproduce this
failure, Could you please send me your sources.list and the
architecture you are using?

Thanks,
Michael

> Best wishes
>
> Norbert
>
> -------------------------------------------------------------------------------
> Dr. Norbert Preining <preining.TakeThisOut@logic.at> Vienna University of Technology
> Debian Developer <preining.TakeThisOut@debian.org> Debian TeX Group
> gpg DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
> -------------------------------------------------------------------------------
> SAFFRON WALDEN (n.)
> To spray the person you are talking to with half-chewed breadcrumbs or
> small pieces of whitebait.
> --- Douglas Adams, The Meaning of Liff
>
>
> --
> To UNSUBSCRIBE, email to debian-devel-REQUEST.TakeThisOut@lists.debian.org
> with a subject of "unsubscribe". Trouble? Contact listmaster.TakeThisOut@lists.debian.org

--
To UNSUBSCRIBE, email to debian-devel-REQUEST.TakeThisOut@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster.TakeThisOut@lists.debian.org

Frans Pop · External Since: May 04, 2006 Posts: 460

Michael Vogt wrote:
> It looks like this is releated to the new code that adds lzma support
> for Package file downloads and the option to configure in what order
> the compression types should be used.

That last is really excellent news! I have some slow systems where using
gzip will be *much* faster than bzip2 is.

But I missed the change (or at least its importance) during my normal
quick scan of the changelog. Could you possibly add a NEWS.Debian item
announcing the new config option (including an example maybe), and also
mentioning the new preference order?

TIA,
FJP

P.S. The new apt runs fine in my amd64-sid chroot, using my local mirror.

--
To UNSUBSCRIBE, email to debian-devel-REQUEST RemoveThis @lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster RemoveThis @lists.debian.org

Michael Vogt · External Since: Jun 28, 2005 Posts: 183

On Fri, Aug 28, 2009 at 05:41:23PM +0200, Norbert Preining wrote:
> On Fr, 28 Aug 2009, Michael Vogt wrote:
> > the compression types should be used. I can not reproduce this
> > failure, Could you please send me your sources.list and the
> > architecture you are using?
>
> amd64, sources.list attached, but some of the repositories are local
> on my disc.
>
> I checked that downgrading made it work again.
[..]

Thanks! David Kalnischkies and I were able to reproduce a crash for
sources that had no Packages file. This is fixed with the 0.7.23.1
upload. Sorry for the trouble, please let me know if that fixes your
issue.

Cheers,
Michael

--
To UNSUBSCRIBE, email to debian-devel-REQUEST DeleteThis @lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster DeleteThis @lists.debian.org

David Kalnischkies · External Since: Aug 29, 2009 Posts: 4

Hi Frans Pop & debian-devel,

> Thanks! David Kalnischkies and I were able to reproduce a crash for
> sources that had no Packages file. This is fixed with the 0.7.23.1
For anybody further interested in the bug:
Something like a index-out-of-bounce, but libapt didn't access the end
(this was checked!) it only iterates over the end... sorry my bad.

On Fri, Aug 28, 2009 at 18:34, Frans Pop<elendil.TakeThisOut@planet.nl> wrote:
> Michael Vogt wrote:
>> It looks like this is releated to the new code that adds lzma support
>> for Package file downloads and the option to configure in what order
>> the compression types should be used.
[...]
> announcing the new config option (including an example maybe), and also
> mentioning the new preference order?
See: man 5 apt.conf -> THE ACQUIRE GROUP -> CompressionTypes
The description is far from being perfect and a few things are missing
so real world input is highly welcomed.
Addition: The order is defined by insertion into the list and missing
default methods will be added automatically at runtime, so everything
you need to do to prefer gzip over bzip2 and lzma would be:
Acquire::CompressionTypes::gz gzip;

NEWS entry> I thought it is more a power user option and
as it changes nothing to the default so imo not fit for an entry,
but after cleaning up the documentation on this option we will
announce it as an aside in an upcoming NEWS entry, i guess.

Best regards / Mit freundlichen Grüßen,

David "DonKult" Kalnischkies

--
To UNSUBSCRIBE, email to debian-devel-REQUEST.TakeThisOut@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster.TakeThisOut@lists.debian.org

Frans Pop · External Since: May 04, 2006 Posts: 460

On Saturday 29 August 2009, David Kalnischkies wrote:
> On Fri, Aug 28, 2009 at 18:34, Frans Pop<elendil.TakeThisOut@planet.nl> wrote:
> > Michael Vogt wrote:
> >> It looks like this is releated to the new code that adds lzma
> >> support for Package file downloads and the option to configure in
> >> what order the compression types should be used.
>
> > announcing the new config option (including an example maybe), and
> > also mentioning the new preference order?
>
> See: man 5 apt.conf -> THE ACQUIRE GROUP -> CompressionTypes

Yes, I found it there (after fetching the source and grepping through
that Smile

I looked in /usr/share/doc/apt/examples/configure-index.gz first, but I
could not find it there. Should it be added?

> The description is far from being perfect and a few things are missing
> so real world input is highly welcomed.

The example currently only shows how to set the first compression type. An
example that also sets a second fallback would be nice.

> Addition: The order is defined by insertion into the list and missing

Inserted before or after current value(s)?

> default methods will be added automatically at runtime, so everything

That's useful to mention explicitly.

> you need to do to prefer gzip over bzip2 and lzma would be:
> Acquire::CompressionTypes::gz gzip;

That's what I did, and it works great! I got a very notable speed
improvement on my sparc box, and expect even better results for my s390
system (running in the Hercules emulator).

Would the following also work to use an *un*compressed packages file:
Acquire::CompressionTypes::"" "";

> NEWS entry> I thought it is more a power user option and
> as it changes nothing to the default so imo not fit for an entry,
> but after cleaning up the documentation on this option we will
> announce it as an aside in an upcoming NEWS entry, i guess.

I think it's worth mentioning, especially if you could also mention, as an
example, that using gzip can improve speed on slower systems.

Thanks,
FJP

--
To UNSUBSCRIBE, email to debian-devel-REQUEST.TakeThisOut@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster.TakeThisOut@lists.debian.org