sentencepiece.git
3 years agoInclude necessary headers to ensure IS_BIG_ENDIAN is defined
Kentaro Hayashi [Mon, 21 Nov 2022 13:17:18 +0000 (22:17 +0900)]
Include necessary headers to ensure IS_BIG_ENDIAN is defined

normalizer.h uses IS_BIG_ENDIAN, which is defined in util.h.
Include util.h here.

Author: Steve Langasek <steve.langasek@ubuntu.com>
Last-Update: 2022-08-27
Forwarded: no
Bug-Debian: https://bugs.debian.org/1017360

Gbp-Pq: Name header-dependencies.patch

3 years agoSupport to build Python module without pkg-config
Kentaro Hayashi [Mon, 21 Nov 2022 13:13:33 +0000 (22:13 +0900)]
Support to build Python module without pkg-config

Gbp-Pq: Name support-python-module-in-place.patch

3 years agoDisable static library explicitly
Kentaro Hayashi [Wed, 28 Oct 2020 11:55:20 +0000 (20:55 +0900)]
Disable static library explicitly

Gbp-Pq: Name disable-static-library.patch

3 years agoFixed the issue of concatinating paths for pkg-config
Taku Kudo [Sun, 21 Aug 2022 03:44:31 +0000 (12:44 +0900)]
Fixed the issue of concatinating paths for pkg-config

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0024-Fixed-the-issue-of-concatinating-paths-for-pkg-confi.patch

3 years agoadded ShutdownLibrary function to uninitialize global variables
Taku Kudo [Sat, 20 Aug 2022 14:34:37 +0000 (23:34 +0900)]
added ShutdownLibrary function to uninitialize global variables

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0023-added-ShutdownLibrary-function-to-uninitialize-globa.patch

3 years agoFix dead links
Aleksey Morozov [Tue, 9 Aug 2022 12:15:51 +0000 (15:15 +0300)]
Fix dead links

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0022-Fix-dead-links.patch

3 years agoFixed errors in example notebook
Aleksey Morozov [Tue, 9 Aug 2022 12:15:30 +0000 (15:15 +0300)]
Fixed errors in example notebook

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0021-Fixed-errors-in-example-notebook.patch

3 years agoUpdated the document
Taku Kudo [Fri, 5 Aug 2022 10:05:52 +0000 (19:05 +0900)]
Updated the document

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0020-Updated-the-document.patch

3 years agosupport slice in pieces/nbests objects
Taku Kudo [Fri, 5 Aug 2022 07:34:44 +0000 (16:34 +0900)]
support slice in pieces/nbests objects

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0019-support-slice-in-pieces-nbests-objects.patch

3 years agoautomatically detect the number of CPUs in batch processing.
Taku Kudo [Fri, 5 Aug 2022 05:47:02 +0000 (14:47 +0900)]
automatically detect the number of CPUs in batch processing.

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0018-automatically-detect-the-number-of-CPUs-in-batch-pro.patch

3 years agoUses property in immutable proto
Taku Kudo [Thu, 4 Aug 2022 07:03:31 +0000 (16:03 +0900)]
Uses property in immutable proto

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0017-Uses-property-in-immutable-proto.patch

3 years agoFixed test failure.
Taku Kudo [Wed, 3 Aug 2022 08:20:01 +0000 (17:20 +0900)]
Fixed test failure.

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0016-Fixed-test-failure.patch

3 years agoremove unused ifdef SWIG macro
Taku Kudo [Wed, 3 Aug 2022 06:45:09 +0000 (15:45 +0900)]
remove unused ifdef SWIG macro

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0015-remove-unused-ifdef-SWIG-macro.patch

3 years agoAdds SWIGPYTHON flag
Taku Kudo [Wed, 3 Aug 2022 03:45:31 +0000 (12:45 +0900)]
Adds SWIGPYTHON flag

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0014-Adds-SWIGPYTHON-flag.patch

3 years agoAdds more unittests
Taku Kudo [Tue, 2 Aug 2022 17:24:53 +0000 (02:24 +0900)]
Adds more unittests

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0013-Adds-more-unittests.patch

3 years agoSupports ImmutableSentencePieceText from python module
Taku Kudo [Mon, 1 Aug 2022 08:19:09 +0000 (17:19 +0900)]
Supports ImmutableSentencePieceText from python module

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0012-Supports-ImmutableSentencePieceText-from-python-modu.patch

3 years agoadd verbose option
Taku Kudo [Sun, 19 Jun 2022 16:35:11 +0000 (01:35 +0900)]
add verbose option

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0011-add-verbose-option.patch

3 years agoAdded ImmutableSentencePiece class
Taku Kudo [Sun, 19 Jun 2022 15:55:46 +0000 (00:55 +0900)]
Added ImmutableSentencePiece class

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0010-Added-ImmutableSentencePiece-class.patch

3 years agoFixed build break.
Taku Kudo [Tue, 14 Jun 2022 17:22:05 +0000 (02:22 +0900)]
Fixed build break.

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0009-Fixed-build-break.patch

3 years agoUses absl::string_view as much as possible
Taku Kudo [Tue, 14 Jun 2022 16:29:55 +0000 (01:29 +0900)]
Uses absl::string_view as much as possible

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0008-Uses-absl-string_view-as-much-as-possible.patch

3 years agoFix a typo
Kentaro Hayashi [Tue, 14 Jun 2022 11:40:59 +0000 (20:40 +0900)]
Fix a typo

gu rantees ->
guarantees

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0007-Fix-a-typo.patch

3 years agoUses std::atomic to define global variable
Taku Kudo [Mon, 13 Jun 2022 17:00:43 +0000 (02:00 +0900)]
Uses std::atomic to define global variable

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0006-Uses-std-atomic-to-define-global-variable.patch

3 years agoUses C++17 by default
Taku Kudo [Mon, 13 Jun 2022 16:18:09 +0000 (01:18 +0900)]
Uses C++17 by default

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0005-Uses-C-17-by-default.patch

3 years agoadd test to use tab as user defined symbols..
Taku Kudo [Mon, 13 Jun 2022 07:46:18 +0000 (16:46 +0900)]
add test to use tab as user defined symbols..

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0004-add-test-to-use-tab-as-user-defined-symbols.patch

3 years agoallow tab character to be used in user_defined_symbols.
Taku Kudo [Sun, 12 Jun 2022 18:20:23 +0000 (03:20 +0900)]
allow tab character to be used in user_defined_symbols.

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0003-allow-tab-character-to-be-used-in-user_defined_symbo.patch

3 years agoremove debug symbols from wheel package
Taku Kudo [Wed, 8 Jun 2022 07:38:21 +0000 (16:38 +0900)]
remove debug symbols from wheel package

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0002-remove-debug-symbols-from-wheel-package.patch

3 years agoupdate python wrapper.
Taku Kudo [Tue, 7 Jun 2022 17:22:21 +0000 (02:22 +0900)]
update python wrapper.

Signed-off-by: Kentaro Hayashi <kenhys@gmail.com>
Gbp-Pq: Name 0001-update-python-wrapper.patch

3 years agosentencepiece (0.1.97-3) unstable; urgency=medium
Kentaro Hayashi [Mon, 21 Nov 2022 13:43:46 +0000 (13:43 +0000)]
sentencepiece (0.1.97-3) unstable; urgency=medium

  * debian/patches/0001-update-python-wrapper.patch
    debian/patches/0002-remove-debug-symbols-from-wheel-package.patch
    debian/patches/0003-allow-tab-character-to-be-used-in-user_defined_symbo.patch
    debian/patches/0004-add-test-to-use-tab-as-user-defined-symbols.patch
    debian/patches/0005-Uses-C-17-by-default.patch
    debian/patches/0006-Uses-std-atomic-to-define-global-variable.patch
    debian/patches/0007-Fix-a-typo.patch
    debian/patches/0008-Uses-absl-string_view-as-much-as-possible.patch
    debian/patches/0009-Fixed-build-break.patch
    debian/patches/0010-Added-ImmutableSentencePiece-class.patch
    debian/patches/0011-add-verbose-option.patch
    debian/patches/0012-Supports-ImmutableSentencePieceText-from-python-modu.patch
    debian/patches/0013-Adds-more-unittests.patch
    debian/patches/0014-Adds-SWIGPYTHON-flag.patch
    debian/patches/0015-remove-unused-ifdef-SWIG-macro.patch
    debian/patches/0016-Fixed-test-failure.patch
    debian/patches/0017-Uses-property-in-immutable-proto.patch
    debian/patches/0018-automatically-detect-the-number-of-CPUs-in-batch-pro.patch
    debian/patches/0019-support-slice-in-pieces-nbests-objects.patch
    debian/patches/0020-Updated-the-document.patch
    debian/patches/0021-Fixed-errors-in-example-notebook.patch
    debian/patches/0022-Fix-dead-links.patch
    debian/patches/0023-added-ShutdownLibrary-function-to-uninitialize-globa.patch
    debian/patches/0024-Fixed-the-issue-of-concatinating-paths-for-pkg-confi.patch
    - Add missing patch files for 0.1.97.
  * debian/README.Debian
    - Add explanation of debian/patches.

[dgit import unpatched sentencepiece 0.1.97-3]

3 years agoImport sentencepiece_0.1.97-3.debian.tar.xz
Kentaro Hayashi [Mon, 21 Nov 2022 13:43:46 +0000 (13:43 +0000)]
Import sentencepiece_0.1.97-3.debian.tar.xz

[dgit import tarball sentencepiece 0.1.97-3 sentencepiece_0.1.97-3.debian.tar.xz]

3 years agoImport sentencepiece_0.1.97.orig.tar.gz
Kentaro Hayashi [Tue, 14 Jun 2022 11:19:58 +0000 (12:19 +0100)]
Import sentencepiece_0.1.97.orig.tar.gz

[dgit import orig sentencepiece_0.1.97.orig.tar.gz]